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ABSTRACT 


This research used modern estimation and control theory, 
flight testing, and statistical analysis to deduce flying 
qualities criteria for General Aviation (GA)- Single-Pilot 
Instrument Flight Rule (SPIFR) operations. The principal 
concern is that unsatisfactory aircraft dynamic response 
combined with high navigation/ communication workload can 
produce problems of safety and efficiency. To alleviate 
these problems, one has to determine first the relative im- 
portance of these factors. This objective was achieved by 
flying SPIFR tasks with different aircraft dynamic configu- 
rations and assessing the effects of such variations under 
these conditions. 

The experimental results yielded quantitative indicators 
of pilot's performance and workload, and for each of them, 
multivariate regression was applied to evaluate several can- 
didate flying qualities criteria. Aircraft configurations 
that are representative of the low-frequency dynamic and 
trim-related airfreime response, and whose ranges of varia- 
tion cover both the existing light aircraft fleet and recent 
trends in GA design, were tested. The implicit model fol- 
lowing algorithm was used to simulate these configurations 
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using Princeton's Avionics Research Aircraft (ARA) and an 
onboard microprocessor-based digital data acquisition sys- 
tem . 

The following important results were derived from this 
research: 

* A phugoid mode that is too lightly damped, produces un- 
satisfactory flying qualities, and it may have an ad- 
verse effect on safety in the SPIFR flight regime. It 
is suggested that the phugoid damping ratio should not 
be lower than 0.04, which is consistent with the cri- 
terion of the military flying qualities specifications. 

* The current FAA reference to stick force sensitivity, 

* 

Af /AV , is qualitative. Any quantification of this 
criterion is important, because it is equivalent to a 
perception by the pilot of having direct control of ve- 
locity, which simplifies the piloting task. Such a 
quantitative upper bound is indicated by the results of 
this research: Af /AV ^ 1.4 Ib/kt. 

* The pitch attitude sensitivity to airspeed change from 

* 

one trimmed flight condition to another. Ad /AV is 

a new criterion, suggested for judgement of the SPIFR 
flying qualities. Its value should not be lower than 
-0.7 deg/kt. 
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Objective performance metrics, such as tracking error RMS 
values, were found to agree with a single subject's opinion 
in SPIFR task evaluation. Also, the current research sug- 
gests that the Cooper-Harper pilot opinion scale is a good 
indicator of perceived pilot workload. Its results indicate 
that the SPIFR navigation/ communication workload is impor- 
tant, compared to workload due to low-frequency aircraft dy- 
namics. 

In the course of this research a niamerically robust al- 
gorithm for optimal flight path reconstruction was developed 
to assure accurate computation of the performance indica- 
tors. This algorithm uses aerodynamic and inertial measure- 
ments and the output of a microprocessor-based multiple Dis- 
tance Measuring Equipment (DME) scanner as inputs, and it 
provides results in True North-East navigational coordi- 
nates. The position accuracy achieved via this integrated 
flight testing and trajectory estimation methodology, using 
low-cost instrumentation, was demonstrated in flight and may 
be readily applied to flight technical error evaluation of 
other navigational systems. 

The main contributions of this research are the identifi- 
cation of longitudinal flying qualities criteria for the GA 
SPIFR flight regime, and the development of an integrated 
methodology for investigation of a complete flight regime, 
including accurate flight path reconstruction. 
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Chapter 1 
INTRODUCTION 


1 . 1 BACKGROUND 


A large portion of air transportation activity is carried 
out by General Aviation (GA) aircraft, which are light air- 
craft often flown by a single pilot. Currently, there are 
about 200,000 active GA aircraft which fly over 40 million 
hours per year, and the projected number of active GA air- 
craft in 1990 is about 300,000 (Ref. 1). Although the po- 
tential exists for GA operations to be of even greater value 
in satisfying air transportation needs, this potential may 
not be realized without substantial improvements in the 
safety, efficiency, and relative cost of GA aircraft. The 
maturing microprocessor technology may help achieve these 
goals, as in the computation of fuel-efficient cruise (Ref. 
2 ). 


This research addressed the safety problem of Single-Pi- 
lot Instrument Flight Rule (SPIFR) operations. A statistical 
analysis of fatal GA accidents (Ref. 3) reveals that most of 
them occur under Instrument Flight Rule (IFR) conditions. 
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The major factors which contribute to an increased hazard in 
SPIFR operations are associated with the serious jump in the 
pilot's workload when going from Visual Flight Rule (VFR) to 
IFR conditions. As pointed out in Ref. 4, these factors 
belong to two distinct categories; (1) deficient aircraft 
dynamic response, and (2) inadequate navigation/communica- 
tion, control and display systems. The work reported in 
this reference results in a recommendation to introduce a 
flight-director display combined with an attitude-command 
control system for the glide-slope segment of the SPIFR mis- 
sion. It constitutes an example of the effort, pursued re- 
cently also by other research teams, to apply modern tech- 
nology to alleviation of the problems of the second 
category. These research workers assume that the latter is 
the dominant factor in pilot workload under SPIFR condi- 
tions. Very little has been done to validate this assump- 
tion and to challenge, if necessary, the deficiencies of the 
aircraft's dynamic response. 

Deficiencies that are particularly relevant to SPIFR 
workload, are trim-related or low-frequency response charac- 
teristics. This is a response region for which it is diffi- 
cult to obtain quantitative flying qualities criteria. In- 
deed, Federal Aviation Administration (FAA) airworthiness 
standards for light airplane design (Ref. 5) provide only 
qualitative guidelines and they address only the short-peri- 
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od oscillations when referring to longitudinal dynamic sta- 
bility! Until recently, there has been little incentive to 
change this situation, as GA pilots flying VFR could cope 
with mild divergences. On the other hand, the military 
light airplanes had to perform additional tasks such as ob- 
servation and consequent communications, which increased 
substantially the pilot's workload and required a more 
"well-behaved" aircraft dynamic response. References 6, 7, 
and 8 represent a research effort which led to the inclusion 
of explicit phugoid-related (long-period) flying qualities 
criteria into the military specifications (Ref. 9). For 
example, the phugoid damping ratio has been restricted to 
f ^ 0.04 for normal (Level 1) flight (it can be unstable in 

£r 

Level 3 ) . 

With the expansion of both VFR and IFR activity in recent 
years, more attention has been focused on flying qualities 
criteria for light airplanes. References 10, 11 and 12 

represent extensive research in this area conducted in the 
Flight Research Laboratory of Princeton University. While 
Ref. 10 and 11 emphasize the short-period response. Ref. 12 

elaborates on all aspects of longitudinal dynamics. For ex- 

\ 

ample, it analyzes the effects of downsprings which are of- 
ten installed to achieve stable force gradients, and con- 
cludes that such a modification in aircraft control design 
may destabilize the long-period oscillation. Finally the 
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authors comment; "Although this is allowed by the regula- 
tions, it appears as a tendency for the airplane to wander 
in speed, pitch attitude and altitude, and the need for con- 
stant stabilization adds to the pilot workload, particularly 
when flying on instruments." This is a qualitative state- 
ment, but it is indicative of the growing awareness of the 
need to analyze the GA SPIFR flight regime. 

This recognition has led several researchers to employ 
digital computers and ground-based simulators in investiga- 
tion of this flight regime. Hinton and Shaughnessy of the 
Langley Research Center of the National Aeronautics and Space 
Administration (NASA) have looked into the adaptation of the 
Time Line Analysis (TLA) to SPIFR workload assessment (Ref. 
13). Bergeron, also of Langley, studied several levels of 
autopilot improvement for General Aviation, and discov- 
ered that an excessively automated mode may be more suscep- 
tible to human operator error (Ref. 14). Reference 15 ad- 
dressed the problem of optimal instrument location and of 
visual scanning workload, using oculometer measurements. 
The results in Ref . 16 indicate that performance in path- 
following tasks improves with increase in display sensitivi- 
ty. All these references simulate complete SPIFR missions 
with the assumption that the cockpit systems workload is 
dominant . 
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This key assumption must be evaluated, and if there are 
significant flying qualities criteria, which represent ap- 
preciable pilot workload due to dynamic deficiencies, they 
should be identified. For ultimate credibility, these an- 
swers must be backed by statistically significant results 
obtained via extensive flight testing under SPIFR 
conditions. Flight testing is the only way to achieve com- 
pletely realistic motion cues, which are rarely matched in 
ground-based simulation; also emotional stress and environ- 
mental factors are most accurately portrayed in flight. 
Such a research effort should not rely solely on subjective 
Pilot Opinion Rating (POR) scales in evaluating flying qual- 
ities criteria. Its conclusions may be more sound if cros- 
schecked with computed performance indicators based on ob- 
jective measurements of pilot performance while performing 
typical SPIFR tasks, e.g., glide slope tracking or airspeed 
holding . 


1.2 GOALS AND SIGNIFICANT RESULTS 


The primary objective of this research was to determine 
the relative importance of the aircraft longitudinal dynamic 
response versus the navigation/communication workload and to 
identify quantitative and statistically significant flying 
qualities criteria for GA SPIFR operations. A flight test 
program involving in-flight simulation of realistic SPIFR 
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tasks and of a range of GA dynamic configurations was con- 
ducted to achieve this objective. As a result, several 
guidelines are being proposed for GA flying qualities cri- 
teria : 

* An explicit lower bound is suggested for the phugoid 
damping ratio. Its value, 0.04, is consistent with the 
criterion of the military flying qualities specifica- 
tions . 

* This research identified an upper bound for the stick 
force sensitivity to airspeed change, which is ad- 
dressed by the FAA regulations only qualitatively; 

^ 1.4 Ib/kt. Any quantification of this 
criterion is important, as it is equivalent to a per- 
ception by the pilot of having direct control of veloc- 
ity. 

* A new criterion, the pitch attitude sensitivity to air- 
speed change from one trimmed flight condition to an- 

Other, Ad /AV is suggested. Its value should not 

comm 

be lower than -0.7 deg/kt. 

These results were obtained using modern control and es- 
timation theory and statistical algorithms, combined with 
realistic in-flight simulation of aerodyneimic configurations 
and SPIFR missions, and accurate data analysis. Those aero- 
dynamic configurations which affect most directly the low- 
frequency dynamic and trim-related airframe response were 
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identified analytically. The range of variation for each of 
these aerodynamic coefficients was chosen to cover both the 
existing light aircraft fleet and recent trends in GA de- 
'sign. For each of the chosen configurations, frequency- and 
time-domain-related candidate flying qualities criteria were 
derived . 

To provide experimental measures of performance under 
SPIFR conditions, the chosen aerodynamic configurations were 
implemented on Princeton's Avionics Research Aircraft (ARA), 
which is capable of simulating in flight a wide range of 
aircraft dynamic responses. A microprocessor-based digital 
data acquisition system was developed and installed, along 
with a new avionics package.^ Planning of the navigational 
trajectories and the experiment design were based on theo- 
retical and statistical considerations. 

To assure accurate computation of performance indicators, 
a numerically robust algorithm for optimal flight path re- 
construction was developed. This algorithm uses as inputs 
the outputs of a microprocessor-based multiple DME (Distance 
Measurement Equipment) scanner along with aerodynamic and 
inertial measurements. This integrated flight testing and 
trajectory estimation methodology, which uses low-cost in- 


^ Details of the ARA and the development of the integrated 
avionics and data recording system are given in Appendix 

A. 
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strumentation, was demonstrated in flight and may be readily 
applied ' to flight technical error evaluation of other 
navigational systems. 


1.3 ORGANIZATION OF THE REPORT 


Chapter 2 presents the derivation of candidate flying 
qualities criteria for SPIFR operations and the theoretical 
aspects of the methodology of SPIFR flight-test design. 
Chapter 3 discusses the application of optimal estimation 
theory to flight-path reconstruction and its implications 
on the methodology of the flight-test design. Chapter 4 
elaborates on the processing of the experimental results, on 
the deduction of performance indicators, and on the deriva- 
tion of SPIFR flying qualities criteria. Conclusions and 
recommendations are presented in Chapter 5 . The experimen- 
tal system, the ARA in-flight simulator, and the onboard 
microprocessor-based data acquisition complex, are described 
in Appendix A. A detailed derivation of SPIFR candidate 
criteria is elaborated in Appendix B. Appendix C contains 
the derivation of the linearized version of the mathematical 
model, required for the optimal flight path estimation. Ap- 
pendix D covers aspects of the flight-test procedure and 
summarizes the complete post-flight processing, whose effi- 
ciency becomes an important factor when applied to a 40-hour 
flight-test series. Experimental pilot opinion rating and 
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commentary data (raw data) are compiled in Appendix E. The 
relevant FORTRAN and Job Control Language (JCL) code list- 
ings were collected in Ref. 17. 
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Chapter 2 


DERIVATION OF CANDIDATE FLYING QUALITIES 
CRITERIA AND SPIFR EXPERIMENTAL DESIGN 

This chapter starts with the formulation of the aircraft 
dynamic model and of its linearization, which are required 
for the derivations in the subsequent sections. Section 2.2 
discusses the identification of SPIFR aerodynamic configura- 
tions and of candidate flying qualities criteria. The simu- 
lation of the chosen configurations on the ARA using the im- 
plicit model following algorithm is presented in Section 
2.3. SPIFR mission planning (Section 2.4) is based on math- 
ematical-statistical modeling of the en-route navigational 
errors. Finally, preliminary flights to verify the system 
are described in Section 2.5. 

2.1 AIRCRAFT DYNAMIC MODEL 

The general formulation of a nonlinear dynamic model of a 
system is, 

X = f (x,u) + w (2-1) 

where x is the state vector and u is the control vector . 
The effect of the vector of disturbances, w will be dis- 
cussed in Chapter 3. The state vector x used here contains 
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three components each of translational rate (u,v,w), trans- 
lational position (Xj, y^, Zj), angular rate (p, q, r) and 
angular attitude (<t>, 6 , ^). Both body and inertial axis 
frames are right-handed with z pointing downward . The Xg 
body axis is aligned with the airplane center line and is 
positive forward of the center of gravity, which is the ori- 
gin of the body frame. The inertial Cartesian frame suita-- 
ble to the derivations of this chapter is the Local Level/ 
Local North (LLLN) axis system. The Forrestal airfield 
reference point has been chosen as its origin, the x^. axis 
points toward North and z^ points toward the Earth center. 
For accurate flight path reconstruction, the LLLN frame has 
to be defined with respect to a new Earth-centered Cartesian 
axis system. This issue is elaborated in Chapter 3. 


The translational rate equation of the aircraft mathemat- 
ical model is, 

iir = ' = -2' 

The airspeed, expressed in body axes, is. 


!ialr = '' 


(2-3) 


Acceleration, expressed in body axes, is. 






(2-4) 



The angular rate cross-product-equivalent matrix 5 is de- 
fined as, 

0 r -q 

r 0 p 

q -p 0 

The gravity vector in the LLLN inertial axis system is, 

= [0 0 g]"^ (2-6) 

Q 

The transformation matrix from inertial (I) body (B) 
axes, with (</>, d , \l/ ) Euler rotations in the specified order, 
is, 

c\pc6 sipcB -s6 

B A 

= ci|;s0s(j)-si^c<|) sips(ps6+c\pc(p c0S(j) 

cij^s0c<J)+stjjs({) s\i)s6c<f)-c\jjs4) cdcip 

where 

s ( ) = sin ( ) 
c( ) = cos( ) 


The second equation of the aircraft motion 6-DOF mathe- 
matical model describes the transformation of body-axis 
rates to Euler angle rates, and it is. 
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p 

• 

I 


9 

= s 

q 



r 


where 


c9 

s9s4> 

s9c<J) 

0 

CdC(p 

-c9s<j) 

0 

S(j) 

C(j) 


(2-9) 


( 2 - 10 ) 


The third dynamic equation combines the effects of air- 
speed and of the wind vector (expressed in inertial 
axes) to compute translational rate. 


2i 


* Hi 


( 2 - 11 ) 


where x^ is the position vector expressed in inertial axes, 
-I " (2-12) 

Q 

Based on the orthonormality of H" in eq. (2-7), 

hJ = (H®)”^ = (H®)*^ (2-13) 


The following relationships constitute the algebraic part 
of the model, yielding the output or the measurement models. 
The airspeed absolute value is. 
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V 


(2-14) 


= IV . 1 = (u^ + 

'JLair' ' 

The angle of attack is given by, 

a = tan"^(w/u) (2-15) 

The sideslip angle definition used here is, 

P = tan“^(v/u) (2-16) 

The angle-of-attack definition is entirely conventional, but 
the sideslip angle definition differs from the conventional 
definition, which is, 

P = sin“^(v/V) (2-17) 

The purpose for using eg. (2-16) rather than eq. (2-17) is 
to assure compatibility with the actual mechanization in the 
ARA; the zero position of the fi-vane is parallel to the Xg 
body axis, and its rotation axis is parallel to the Zg body 
axis . 

Assuming that the origin of the inertial frame is at sea 
level, the altitude h is, 

h = -Zj (2-18) 

The acceleration vector 3g of eq. (2-2) and (2-4) reflects 
the effect of aerodynamic and thrust forces acting on the 
airframe. 
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To examine the effects of the low-frequency longitudinal 
dynamics and trim-related response on SPIFR performance, the 
ARA was used as an in-flight simulator. The capabilities of 
this experimental vehicle and their enhancements, introduced 
for the purposes of this research, are described in detail 
in Appendix A. Its nonlinear dynamic model (Ref. 18) con- 
stitutes a submodel of the general formulation in eq. (2-1) 
to (2-18): 


u = a^ - qw - gsd = (qS/m)C^(a,T^, 5F) - qw - gs0 (2-19) 

• ~ I 

w = a + qu + gcd = (qS/m)C (a,T ,5F,6E,q)+ 
z z c 


qu + gcd 

(2-20) 

q = (qSc/lyy)Cjjj(a,T^,5E,q,w) 

(2-21) 

. 

II 

(2-22) 

• 

Xj = ucd + \fsB 

(2-23) 

Zj =-us0 + wed 

(2-24) 

Accompanying relationships are. 


oc = tan”^ (w/u) 

(2-25) 

q = 0.5 

(2-26) 

V = (u= + 

(2-27) 
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(2-28) 


Tc = t 1^T.= 2->pP„^,/pS 

■*■ ■*■ '^c (2-29) 

<=z = <=zo + =z.“ + =zJF«f + =z«E«= ’ <«<14.3 deg) (2-30) 

=m = <^n,c + =m“ + %(0.5c/V)q 4 C^5E(l+XpgAt)5E 

+ (Xcg/c)Cz + (Xt/c)Tp (2-31) 

In these equations m is the aircraft mass (slugs), is 

the pitching moment of inertia (slugs-ft ), S is the wing 

(reference) area (ft ), i?p is the propeller efficiency, and 

is the maximum power available. is the maximum 

max ^ max 

thrust (for throttle travel 5T of 100%) available with 

nia.X 

(lb), c is the (reference) mean aerodynamic chord length 
(ft), x^g is the axial center of gravity location with re- 
spect to the reference point (ft), is the vertical (in 

body axes) distance between the thrust line and the aircraft 
center of gravity, and 1^ is the distance between wing and 
horizontal tail centers of pressure (ft). The aerodynamic 
coefficient 0^^^^ is augmented to account for the or-effect, 
5E is the elevator deflection and 5F is the flap deflection. 

For analysis purposes, the above model can be linearized 
about a nominal trimmed flight equilibrium. Given airspeed 
and altitude, these flight trim values were found by mini- 
mizing a quadratic function of u, w and q (Ref. 19). At 
this function's minimum; 
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u 


(2-32) 


= w = q = q = 0 

d = a (y = 0 , straight and level flight) (2-33) 

As reported in Ref. 20, the full-scale Navion aircraft was 
tested in a wind tunnel with an electrical motor actually 
driving the propeller at several power settings. These data 
were crosschecked with results of numerous flight tests. 
This provides a sound basis for the theoretical analysis. 

With the SPIFR-related onboard systems, the ARA longitu- 
dinal inertial data are, 

m = 93.17 slugs = 3000 lb (2-34) 

lyy = 2829.5 slug-ft^ (2-35) 

All configurations were flown within an airspeed range of 
75 knots to 105 knots and at altitudes up to 3000 ft. Thus, 
for configuration matching and candidate SPIFR criterion de- 
duction, a typical flight equilibrium condition of 75 knots 
and 2000 ft was chosen: 

h = 2000 ft , «>2ooo/'’sl = ■ ''sl/''2000 = 0-97'2-36) 

V = 75 KIAS = 130.6 fps (TAS) (2-37) 

T =VP CT ^CT /V = 0.8X156750x0.985/130.6 

max p maxSL 2000' SL' 

= 945 lb (2-38) 
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T^(5T=100%) = 945/3570 = 0.265 


(2-39) 


Finally, the level flight trim values are. 


a = = 8.77 deg (2-40) 

5E = 4.5 deg (2-41) 


5T = 49.4% 


(2-42) 


Linearization of the equations of motion provides a use- 
ful means for assessing the stability of the aircraft and 
its response to small perturbations. Expanding the system 
mathematical model in a Taylor series with respect to the 
above set of nominal conditions and disregarding the nonli- 
near terms (Ref. 21), 


"Au" 


r X 

u 


-w+X ■ 

q 

-gc6 ‘ 


"Au" 


^6E 

XgT 

^6F 


"A6E" 

• 

Aw 


Z 

u 


u+Z 

q 

-gs0 


Aw 


^5E 

^6t 

"6F 




= 







+ 





A6T 

Aq 


M 

u 

M 

w 


0 


Aq 


^6E 

^6t 

^6F 



•CD 

<1 


0 

0 

1 

0 


A0 


0 

0 

0 


A6F 

L J 









* 


- 


•• <■ 


(2-43) 


The translational position variables were omitted from 
this formulation. The range, x^ does not affect the air- 
craft dynamics, so its eigenvalue is identically zero. The 
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height mode (Ref. 21) which arises from the altitude depen- 
dency on air density, also is of no consequence under SPIFR 
conditions. The ARA's height mode has a stable time con- 
stant of about 1000 sec, which is substantially longer than 
the time scale of the phugoid mode. Equation (2-43) is of 
the form of a state equation, 

• 

Ax = FAX + (2-44) 

where F is the state matrix, G is the control matrix. Ax is 
the state vector and An is the control vector. F and G are 
the linearization Jacobians, 


F = af/axl^=^„ 


u=uo 


(2-45) 


G = (2-46) 

As obvious from eq. (2-43), they consist of the conventional 
stability-and-control derivatives. The matrix F is useful, 
as its eigenvalues predict the local stability of the flight 
path motion (Ref. 22). For example, eigenvalue X^, of a 
dynamic response mode i, provides both the natural frequency 
and the damping ratio of this mode. 


“ni ” <2-47) 

(f‘^n^i = (2-48) 


2-10 



( f W ) . /03 . 


( 2 - 49 ) 


= 


The numerical values of the F and G elements (eq. 
(2-43)), based on the chosen nominal flight equilibrium are. 


^u = 

-0.083 sec”^ 

(2-50) 

= 

+0.094 sec”^ 

(2-51) 

-w+X 

( 

= -Vsa = -19.95 fps 

(2-52) 

= 

-qc d = -31.7 ft/sec^ 

(2-53) 

Z = 
u 

-0.549 sec”^ 

(2-54) 

Z = 
w 

-1.30 sec ^ 

(2-55) 

u+Z 

q 

= Vc at = 129.1 fps 

(2-56) 

Zq = 

2 

-qsd = -5.25 f t/sec 

(2-57) 

M = 
u 

+0.0037 ft"^-sec"^ 

(2-58) 

M = 
w 

-0.065 ft“^-sec"^ 

(2-59) 

M = 

q 

-2.124 sec“^ 

(2-60) 

^5E 

= 0 

(2-61) 


= -0.089 sec ^ 

(2-62) 

^5E 

= -9.82 sec“^ 

(2-63) 


= +0.17 ( ft/sec^ ) /mm 

(2-64) 
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^6t' ^6t' ^ 

(2-65) 

^6f ^ -0.242 ft/sec^ 

(2-66) 

Z 5 p = -34.7 ft/sec^ 

(2-67) 


2.2 IDENTIFICATION OF SPIFF AERODYNAMIC CONFIGURATIONS AND 
CANDIDATE FLYING QUALITIES CRITERIA 

Identification of the aerodynamic parameters that are 
most likely to affect airplane performance and pilot work- 
load under SPIFF conditions, constitutes an important aspect 
of this research. The analytical tools, used both to iden- 
tify the SPIFF aerodynamic configurations^ and to derive the 
candidate flying qualities criteria, include eigenvalue or 
frequency/damping computations and examination of transient 
and steady-state airframe characteristics. Consequently, 
both time- and frequency-domain metrics were considered. 
The eigenvalues were computed based on F (eq. (2-43)) and 
the computation of the transient characteristics (e.g., ov- 
ershoots and rise times following a control step input) in- 
volved linear interpolation of tabulated data and numerical 
integration (fourth-order Runge-Kutta algorithm; Ref. 23) 


As used here, a configuration is a set of aerodynamic 
coefficients that characterizes the dynamic response of an 
aircraft. 
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of the set of nonlinear differential equations presented in 
the previous section. For the SPIFR flight regime, the 
long-period motion component of these results may be expect- 
ed to be of most interest; the short-period, which is the 
higher frequency mode, is well separated from the phugoid 
for the GA-type airplanes . 

With regard to the steady-state characteristics, an im- 
portant feature of the SPIFR flight regime is that the pilot 
often is required by Air Traffic Control (ATC) to change al- 
titude or airspeed. Each such flight path variable change 
is produced by a combination of thrust and horizontal con- 
trol surface adjustments. A configuration which requires 
large control deflections to retrim from one flight equilib- 
rium to another may seriously increase the pilot ' s workload 
under already-strained SPIFR conditions . The output command 
algorithm (Ref. 24) constitutes the most suitable analyt- 
ical tool for the identification of such critical configura- 
tions . Its mathematical formulation is based on adding an 
output equation to the state equation, eq. (2-44) of the 
previous section, 

• 

^ = F Ax + G AQ (2-44) 

42 = ( 2 - 68 ) 

Av represents the desired flight-path variations. and 

are output matrices . Solving these two equations simultane- 
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ously, both the required state and control perturbations are 
found , 


f- * 1 

Ax 


■ F 

G 

-1 

■ 0 

★ 

Aa . 


•«x 

«u - 


^comm- 


or. 


(2-69) 


0 = FAx* + GAu * 

Ay = H Ax* + H Au* 

— ^omm X — u — 


(2-70) 


( ) symbolizes the steady-state variations in state and 
control that correspond to 4^comm’ solution to eq. 

(2-70) is. 


Ax* = -F"^GS 
— — ^comm 

* 

Aa = S Ay 

^^comm 


where 


(2-71) 

(2-72) 


S = (-H,^F"^G + H^)-^ ~ (2-73) 

Conversely, the aircraft response to the pilot's commands 
after the decay of all transients is obtained from eq. 
(2-44) by setting Ax = 0, 
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Ax 


= -F"^GAu 


comm 


(2-74) 


As a result of preliminary analysis the following aerody- 
namic parameters received priority for SPIFR flight testing: 


(a) X^, z„, Z„, 


<'=> ^SE- ^ST' « 


ST 


These stability and control derivatives fall into two cat- 
egories: those that affect only trim and those that affect 
both trim and stability. Control derivatives listed in (b) 
fall into the first category because, as demonstrated by eq. 
(2-43), they appear in the control matrix G, thus affecting 
Ax and AQ • Stability derivatives listed in (a) fall into 
the second category because they appear in the F matrix, 
thus affecting both trim and stability. 


Now let us elaborate on the physical significance of 
changing each of the chosen aerodynamic coefficients and on 
deduction of candidate flying qualities criteria for GA 
SPIFR operations. The derivative is the equivalent of 
-TL^, which is defined with respect to the flight path 
(hence not exactly identical to Z^) . As follows from clas- 
sical airplane stability theory (Ref. 25), the square of 
the phugoid natural frequency, may be approximated as a 
linear function of TL^, 
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(2-75) 


“np = g(TLy/V) = 2(g/V)2 

Accounting for compressibility but not for the generally 
negligible thrust effect on 

TI^ S (g/V)(2 + = 

(g/V)[2 + (1-C^ /C^ )M^/(1-M^)J (2-76) 

As may be observed from eq. (2-75) and (2-76), for low-speed 
GA aircraft is proportional to the inverse of V. Thus 

flying configurations with a range of Z^-values provides 
data for both slow aircraft and for small jets, which often 
are involved in SPIFR operations. The latter achieve higher 
airspeeds and may feature nonzero zero-lift coefficients 
which tends to offset the compressibility effect (eq. 

^o' 

(2-76)) . 

The derivative is the equivalent of -TD^; as shown in 
Ref. 25, the phugoid damping is a linear function of this 
coefficient, 

r = -0.5TD„/w„„ (2-77) 

^ p V' np 

Substituting from eq. (2-75), 

fp = -0.35TDy/(g/V) (2-78) 

As a design parameter, -TD^ may be approximated by. 
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(2-79) 


-TD^ = 2(g/W){C^/Cj^) = 2(g/V)(L/D) ^ = 

= 2(g/V) (1/Te) (Cj^/AR) 

Thus configurations with low values of may represent ul- 
tra-light aircraft designs or airplanes with high aspect 
ratios. As suggested in Chapter 1, excessively low phugoid 
damping values may be problematic under SPIFR conditions . 
Due to the contribution of the compressibility effect, the 
derivative increases for higher-airspeed aircraft. This 
may be important in small jet designs; for propeller-driven 
airplanes the phugoid damping increases due to the power ef- 
fect . 

Special circumstances or control design considerations 
may also affect As pointed out in Ref. 26, the wind 

shear effect tends to destabilize the phugoid and, as noted 
in Chapter 1, this is true also with regard to the installa- 
tion of downsprings. Thus, by flying SPIFR missions with a 
wider range of X^ or configurations, we gain insight into 
these effect as well. 

• 

The derivative represents the "lift curve slope" ef- 
fect. Reference 25 provides an empirical fit for the lift 
coefficient for the entire range of wing aspect ratios. 


= x^(l+i;i+( .5 aVcA)^(I-M^c^A)]^/^) (2-80) 
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As obvious from eq. (2-80), increasing the values of such 
design parameters as AR or cruise airspeed, improves the aer- 
odynamic efficiency of a configuration; wing sweep tends to 
reduce C- . 

As emphasized in Ref. 25, is an important design pa- 
rameter which may destabilize the long-period longitudinal 
motion (shown there via root locus sensitivity analysis). 
Its numerical value is a function of the airplane configura- 
tion and of the specific flight condition. For example, a 
configuration design could feature a high wing and wing- 
mounted engines and propellers. The resulting variations in 
aerodynamic forces acting through a larger moment arm may 
affect substantially. Another aerodynamic coefficient 
which may be affected by such a design is 

With regard to the derivative, negative values may 
correspond to augmented upper-surface-blowing (Thrust Vector 
Control or TVC), and positive values simulate an adverse 
situation in which the engine is tilted forward without an 
appropriate thrust compensation, resulting in airplane de- 
scent along with horizontal acceleration. If the design 
goal is a configuration with a shorter body, the vertical 
force sensitivity of the elevator may be affected. To 
preserve its moment effectiveness the designer may in- 
crease the elevator area and create more negative On 
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the other hand, introduction of a canard control surface, as 
on Burt Ruttan's "Vari - Eze" or on the 
Old Man's Aircraft Co.'s "OMAC 1" aircraft, may result in 


It is important to evaluate the effect of variation of 
these aerodynamic coefficients under realistic SPIER condi- 
tions as guidance for future designs. The ranges of varia- 
tion in the chosen' stability and control derivatives were 
defined with respect to the nominal Navion, which possesses 
"well-behaved" mid-spectrum dynamic characteristics (eq. 
(2-50) to (2-67)). 

Along with reflecting trends in GA aircraft design, these 
ranges of variation have to account for practical implemen- 
tation issues. For example, aerodynamic coefficients such 
as M^, Zg,p, and Mg,p have very small numerical values for the 
basic ARA configuration. For such parameters, instead of 
defining the range of variation in terms of a percentage of 
the nominal value, a different approach was taken. The var- 
iation envelopes were opened in preliminary flight-testing 
by increasing the absolute value of the coefficient to a 
level, which has a distinct effect on the aircraft's dynamic 
response. ^ is an example of a parameter for 
which it was important to obtain a significantly wide abso- 
lute range of variation, because of its sensitivity to vari- 
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ations in trim conditions and, in particular, to the hori- 
zontal stabilator incidence setting. Note also that in fly- 
ing the Zg,j, and the configurations, vas kept 

constant. As this coefficient reflects the actual power 
setting, the physically more important variations in the 
ratios Zg,p/Xg^ and were simulated. The nu- 

merical values for the final SPIFR configurations, with re- 
spect to the nominal one (eq. (2-50) to (2-67)), are; 


Xu = 0 7 -0.166 sec“^ (200% of Nominal) (2-81) 
AZ^ = +30% of Nominal (2-82) 
AZ^ = +50% of Nominal (2-83) 
AM^^ = ±0.01 ft“^-sec“^ (2-84) 
Z^E = ±(200% of Nominal) (2-85) 
AZ^q, = ±0.13 (ft/sec^)/mm (2-86) 
AM^q, = +0.014 (rad/sec^ ) /mm (2-87) 


For briefness in the following discussion, a reference num- 
ber was assigned to each configuration (Table 2.1). 

The details of the derivation of the candidate criteria 
for these configurations are given in Appendix B. The re- 
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TABLE 2.1 


Reference Number Assignment to the SPIER Configurations 


COI- 

EIGU- 

RATIONI 


^T ■ 

AZ^T 

^6E 

«u 




>0 

<0 

>0 

<0 

2N 

-2N 

>0 

<0 




2N 

s 

0.5N 

CODE 

■ 

2 

3 

4 

5 

6 

■ 

9 

10 

11 

12 

13 

14 

15 

16 


suits of this derivation are presented in Table 2.2 in a 
format, compatible with the statistical analysis of Chapter 
4. This analysis is to decide which candidate criteria ma- 
terialize as actual flying qualities criteria, following re- 
alistic SPIER mission flight testing. Eigure 2.1 is a visu- 
alization of the range of variation of the candidate 
flying qualities criterion. 
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SPIFR 


CONFIG- 

URATION 

. 4 — . . 

RAD/SEC 

= 4 deg 
' comm ^ 

= 10 Kt 

comm 

A6* 

AV 

comm 

[DEG/KT] 

Afs* 

comm 

[LB/DEG] 

Afs* 

^Ycomm 

[LB/DEG] 

1 

0.054 

-4.7 

4.7 

n 

2 

0.054 

-4.7 

4.4 


3 

0.054 

-4.7 

5.0 


4 

0.054 

-4.9 

4.8 

-0.69 

5 

0.054 

-4.6 

4.5 

0.83 

6 

0.054 

-5.1 

5.0 

.18 

7 

0.054 

-4.1 

3.9 

.14 

9 

0.067 

-4.7 

6.2 

.17 

10 

0.040 

-4.6 

3.2 

.17 

11 

0.047 

■ -3.7 

3.4 

.17 

12 

0.060 

-5.7 

5.9 

.17 

13 

0.011 

-4.7 

mm 

.17 

14 

0.096 

-4.7 

mm 

.17 

15 

0.056 

-9.1 

9.8 

.36 

16 

0.052 

-3.4 

3.2 

.11 


SEC 

t^(6T) 

SEC 

4.5 

0.50 

4.5 

8.0 

4.5 

2.0 

4.5 

1.0 

4.5 

9.0 

4.5 

0.50 

4.5 
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Figure 2.1: Total Damping Variations for SPIFR 

Configurations 
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IMPLEMENTATION OF SPIFR CONFIGURATIONS VIA IMPLICIT- 
MODEL^FOLLOWING ALGORITHM 

The chosen SPIFR configurations were simulated on the ARA 
using the Implicit-Model-Following algorithm to generate 
control laws {Ref. 27). State equations of the type of eq. 
(2-43) may be written for the nominal ARA configuration 
(subscript ARA) and for the configurations to be simulated 
(subscript M) , 

• 

^ARA “ ^AR/A^ARA ^^ARA^ARA (2-88) 





(2-89) 


The objective was to obtain the control vector Au„ 
which will make the ARA respond as the required configura- 
tion. The perfect model following objective is, 

• • 

—ARA “ A2Em (2-90) 

given = x„(0) 

Substituting eq. (2-88) and (2-89) into eq. (2-90) and 
rearranging. 
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^^AEA 


where 


~ ^ARA^^ARA ''' “ 

^B^ARA ■*■ ^F^M 


G 


# 

ARA 


/pT p »—lpT 

'^ARA^ARA^ ^ARA 


Eq. (2-90) renders, 


(2-92) 


^ARA 


= 


(2-93) 


Thus, Ax^j^ is the solution of eq. (2-89). Erzberger has 
shown that this yields perfect model following if there are 
no additional constraints ' on control usage or parameter in- 
sensitivity. A block diagram of the derived algorithm is 
presented in Figure 2.2. 


Para 



Figure 2.2; Block Diagram for Implicit Model-Following on 
the ARA 
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The elements of Cg and of Cp constitute the theoretical set 
of gains required to simulate a given configuration in 
flight, using the ARA. However, to implement this set of 
gains, we must account for calibration constants, control 
gearing ratios, and, in some instances, for physical rela- 
tionships between the sensor output and the associated state 
variables, which are fed back via Cg. These effects are now 
incorporated into the scheme of Fig. 2.2 (Fig. 2.3). 



Figure 2.3; Implementation of a SPIFR Configuration on the 
In-Flight Simulator 


The added matrices Ap and Ag provide the required engi- 
neering corrections to the theoretical gain matrices Cp and 
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Cg, respectively. They include the calibration constants 
(slopes and biases), which translate these gains into actual 
potentiometer settings. This information has been compiled 
in the "VRA and ARA Calibration Data Manual" (Ref. 28). A„ 

r 

also accounts for the gearing ratios between the cockpit 

2 

controls and the control effectors. 

As already mentioned, in some cases the required inputs 
to the feedback loop in the scheme of Fig. 2.3 are more com- 
plex functions of the corresponding sensor output than a 
trivial one-to-one equivalence. For example, the angle of 
attack sensor, although positioned as far as was practically 
possible from the wing tip, is affected by "upwash" in the 
flow. The relationships between the measured values and the 
actual physical variables were incorporated into matrix Ag, 
making it, in a sense, a static estimator. 

Finally, the actual potentiometer setting matrices for 
the feedforward and the feedback loops are [CpAg] and 

^ARA ” ^'^B*B-'^ARA (2-94) 


2 

The control effectors are the actual mechanical devices 
(elevator, throttle, etc.), which apply the aerodynamic 
forces and torques which move the airplane. 
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The elements of the potentiometer setting matrices consti- 
tute a direct output of the implicit model following comput- 
er program. The program was run for all SPIFR configura- 
tions, and the results are summarized in Table 2.3. Only 
the primary gain setting for each configuration is present- 
ed, as the secondary cross effects turned out to be negligi- 
ble . 
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TABLE 2.3 


Gain Settings for In-Flight Simulation of SPIFR 

Configurations 


POR THE NOMINAL ARA CONFIGURATION: M^^-GAIN - -65, Xj^-GAIN»-51 AND ALL OTHER GAINS - 0. 

THE FOLLOWING GAIN SETTINGS ARB VARIATIONS WITH RESPECT TO NOMINAL. 

CONFIGURATION 

GAIN SETTING 

2 

+ 20 

3 

- 20 

4 

+ 22 

5 

- 22 

6 

+ 19 

7 

- 57 

9 

+ 24 

10 

- 24 

11 

- 15 

12 

+ 15 

13 

+ 28 

14 

- 28 

15 

+ 35 

16 

- 35 
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2.4 EFFECTS OF NAVIGATIONAL ACCURACY AND OF THE "LEARNING 
CURVE ” ON MISSION PLANNING 

For realistic SPIFR simulation, the mission has to con- 
tain several typical flight-path segments, including 

* Climb, acceleration, and cruise with airspeed retrim- 
ming 

* Holding pattern 

* Deceleration and descent 

* Interception of the landing system beam 

* Approach and missed-approach go-around 

Also, a realistic VOR*^ navigation simulation should consist 
of engaging navigational stations in the "TO" as well as 
the "FROM" mode. The above considerations roughly size the 
SPIFR mission simulation to a flight duration of about thir- 
ty minutes, with the geometry shown in Fig. 2.4. 

One problem associated with selecting the flight path ge- 
ometry is the "learning curve" effect. This is the ability 
of a human being to improve his performance by repeating the 
same task. Flying all missions along the same trajectory 
allows the pilot to memorize control patterns, reducing the 
navigation workload to a level that is unrealistic for a 
real mission. To cope with this issue, additional flight 
path variants were devised (Fig. 2.5, 2.6, 2.7). All vari- 

3 

VOR IS a navigational system and the acronym stands for 
Very-high-frequency Omni Range. 
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ants have different altitude and airspeed profiles but, are 
of comparable structure and flight duration. Also, the or- 
der in which the various configurations and tracks were 
flown was randomized. 

The other problem associated with the selection of flight 
path geometry is navigational accuracy. Appropriate trajec- 
tory planning may keep the flight technical error to minimum 
and prevent divergence between navigational tracks . It may 
also improve the accuracy of post-flight flight path recon- 
struction, as will be shown in Chapter 3. The standard nav- 
igational modes for GA flight are VOR/VOR, and VOR/DME. At 
least two VOR-only stations are required to achieve a hori- 
zontal "fix" of the aircraft's position (a single VOR/DME 
station is sufficient) . With proper geometry these modes 
can provide an accurate position estimate. 

Geometric Dilution Of Precision (GDOP) affects naviga- 
tional accuracy. GDOP is an inaccuracy due to the nonper- 
pendicularity of the lines connecting the aircraft with the 
engaged stations. Applying analytical geometry to the typi- 
cal situation depicted in Fig. 2.8 and assuming that the two 
navigation stations' errors are statistically uncorrelated, 

a =(l/s9) [0^ + (2-95) 
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a 



Figure 2.8; Ground Stations Engagement in the VOR/VOR or 
the DME/DME Modes. 

The 1/s 6 term reflects the GDOP effect. For angles 
between radials in the vicinity of d = 0 or d = 180 deg, 
the position error becomes very large, becoming infinite in 
the limit. To improve position accuracy using two similar 
ground stations while flying a given leg, it is desirable 
that the stations be as nearly perpendicular as possible. 
For VOR/VOR, eq. (2-95) can be rewritten as, 

,, ._2„,l/2 

VOR/VOR ^ ^2g 

For DME/DME, eq. (2-95) becomes, 

= \/2 


(2-96) 


(2-97) 


DME/DME 
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The accuracy requirements imposed by the FAA are (Ref. 


29 ) : 



^VOR 

^DME 


= 1.9“ 

= <?. 15% range or 0.1 mile: 
whichever is larger 


(2-98) 


Numerical values of eq. (2-98) and dependence of ‘^vqr/VOR 
— 2 

sxn 0 suggest that this navigation mode is much less accu- 
rate than the DME/DME mode. For example, at a range of 50 
miles from both stations and for 9 = 30 deg the VOR/VOR er- 
ror is 2.71 miles, while the DME/DME error is 0.28 miles; 
the results favor the DME/DME pairing at greater ranges. 
Based on this observation and on the feasibility of micro- 
processor-controlled sequential engagements of several DME 
stations, it was decided that a DME switching technique 
should be used to improve the flight path reconstruction ac- 
curacy. In particular, this accuracy improvement may be 
achieved by making use of redundant measurements, while ap- 
plying the optimal Kalman filtering/ smoothing algorithm. 
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2.5 IN-FLIGHT VERIFICATION OF THE SPIFR RESEARCH CONCEPT 


To test the complete SPIFR-mission-simulation concept, a 
series of preliminary flights were carried out. Its main ob- 
jectives were to verify the realism of simulation of the SPIFR 
regime environment and the in-flight configuration matching 
capability. After extensive hangar and in-flight checks of 
the aircraft system modifications, of the new navigation/co- 
munication package and of the onboard experimental setup, 
the proposed instrument tracks (Fig. 2.4 to 2.7) were flown, 
totalling about ten flight hours. 

These preliminary flights have shown that the tasks ap- 
pear to simulate IFR missions, which are realistic in both 
geometry (Section 2.4) and workload. With regard to work- 
load, the McGuire Air Force Base approach control frequency 
was tuned in for realistic background chatter. The safety 
pilot, who played the role of the air traffic controller, 
delivered real-time clearances to the evaluation pilot. 
Clearances were delivered and read back, after being copied, 
using the voice-operated intercom. To avoid interference, 
the McGuire approach control audio was deselected during 
these communications. Tuning in VOR/DME stations, VOR 
tracking and navigation to waypoints, executing holding pat- 
tern turns, leveling off from climb, airspeed retrimming, 
changing altitude, localizer interception, and other ele- 
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ments of a typical SPIFR scenario were excersized during 
these flights. The first of the four navigational 
tracks of Fig. 2.4 to 2.7 was found to take about 20% more 
time than the other three. To keep the missions comparable 
in workload, it was not flown during the actual flight test 
series . 

To evaluate successfully the relative importance of the 
low-frequency airfreime dynamic response and the SPIFR navi- 
gation/communications tasking, all other workloading effects 
had to be minimized. Thus, all the test flights of the pro- 
gram were carried out under zero-to-light natural turbulence 
conditions. Turbulence, which is a higher-frequency phenom- 
enon, could have obscured the long-period configuration 
trends. 

The preliminary flight tests also were used to verify 
various in-flight procedures. Normally three SPIFR missions 
were flown per flight. Before a mission was initiated, the 
safety pilot had to "dial in" the aerodynamic configuration 
gains (Table 2.3 ) . Then he turned the "new" aircraft 

over to the evaluation pilot for a brief familiarization 
period. During this period the safety pilot switched digi- 
tal recording cartridges, brought the data acquisition sys- 
tem into the "stand by" mode, and tuned in the McGuire Air 
Force Base approach control radio frequency. 
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To confirm the matching capability, each of the chosen 
aerodynamic configurations was simulated in flight during 
these preliminary experiments. As shown in Section 2.2, the 
interactive approach which combined the theoretical consid- 
erations with real-life flight testing, played an important 
role in the program's success. 

To verify the ARA dynamic model , through which the SPIFR 
candidate flying qualities criteria were derived, numerical 
values of several of them were obtained experimentally and 
compared to the preliminary calculations. The phugoid natu- 
ral frequency and damping characteristics were measured by 
first stabilizing the airplane and trimming the elevator 
control force to zero at 2000-ft altitude and 75-kt air- 
speed. The airspeed then was decreased by about 10 to 20 
knots using the elevator control. At this point the yoke 
control was smoothly returned to its zero position. The re- 
sulting phugoid oscillation was permitted to persist for 
about 3 to 4 cycles. This procedure was carried out for 
configurations No. 1 and 9 to 14 which, as may be observed 
from Table 2.2, were quite different from the nominal Navion 
characteristics (configurations No. 2 to 7 consist of con- 
trol effect changes, which do not affect the 
'ttL-iue. ) • After the damping of the short-period motion, the 
phugoid is characterized as follows. 
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a = const. 


7=0 (2-99) 

From the recorded 0(t) time histories the time to half the 
amplitude, period of the oscillation, P were 
obtained. Then, using the technique of Ref. 30, 


Imj^ = 2ir/p 


(i) 

np 


(1 - 


(2-100) 


Rex = ln2/ti/2 = “np^p 


(2-101) 


The resulting values of and were computed using eq. 
(2-47) to (2-49), and crosschecked with the theoretical val- 
ues (Table B.l). For another confirmation of the theoreti- 

It 'it ^ 

cal results, numerical values of A® , A5g and of A5,j, for 
A^tju iiu„ ~10 were obtained through flight testing and were 
compared to the corresponding values in Table 2.2. For each 
of the fifteen configurations, the airplane was trimmed at 
1500-ft altitude and 75-kt airspeed, then retrimmed at the 
same altitude and 85 kt. Examples of the comparison between 
theoretical prediction, and experiment are given in Table 


2.4. The phugoid natural frequency, 


results are 


somewhat biased down with respect to the predicted values. 


but the trends are correct. For the pitch angle change, 
A0*, the effects of variation of the aerodynamic coeffi- 
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cients were also obtained to a good approximation. This 
comparison renders confidence in the theoretically-derived 
candidate flying qualities criteria. 


TABLE 2.4 

Experimental Verification of the Theoretical Dynamic Model 


■ 

[RAD/SEC] 

ie*[DEG] FOR 


PREDICTED 

EXPERIMENTAL 

PREDICTED 

EXPERIMENTAL 

1 

0.34 

0.32 

- 4.7 

- 4.4 

2 



- 4.7 

- 4.3 

3 



- 4.7 

- 4.2 

4 



- 4.9 

- 4.7 

5 



- 4.6 

- 4.2 

6 



- 5.1 

- 5.0 

7 



- 4.1 

- 3.9 

9 

0.38 

0.35 

- 4.7 

- 4.3 

10 

0.28 

0.26 

- 4.6 

- 4.7 

11 

0.29 

0.27 

- 3.7 

- 3.4 

12 

0.38 

0.36 

- 5.7 

- 5.5 

13 

0.34 

0.33 

- 4.7 

- 4.4 

14 

0.33 

0.30 

- 4.7 

- 4.5 

15 

0.35 

0.34 

- 9.1 

- 8.2 

16 

0.33 

0.34 

- 3.4 

- 3.6 
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Chapter 3 


FLIGHT PATH RECONSTRUCTION - THEORY AND 
APPLICATION 

To decide which of the candidate criteria (Table 2.2) are 
suitable metrics of GA SPIFR flying qualities, a statistical 
comparison with experimentally derived system performance 
measures must be made. This required accurate estimates of 
flight path variables, which were measured directly or had 
to be reconstructed from other noisy measurements. First, 
Section 3.1 elaborates on the extensions to the system's 
mathematical model, that are required for flight path recon- 
struction. Section 3.2 discusses the post-flight optimal 
filtering and smoothing algorithms ' formulations . Develop- 
ment of the filter tuning methodology and results of apply- 
ing the algorithm to SPIFR experimental data are presented 
in Section 3.3. 


3.1 DYNAMIC MODEL GENERALIZATION 

As pointed out in Section 2.1, the system model should be 
generalized to allow accurate post-flight trajectory estima- 
tion. This generalization includes an introduction of a new 
Earth-centered Cartesian axis system, and it accounts for 
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the effects of Earth rotation and geometry. This was done 
by defining the motion of the LLLN Cartesian coordinate 
frame with respect to this new axis system. The mathemati- 
cal model of Section 2.1 will be revised, and the required 
modifications will be introduced wherever they are due. A 
closer look at this model reveals that it consists of two 
distinct submodels, the angular submodel (eq. (2-9) and 
(2-10)) and the translational submodel (eq. (2-2) and (2-11) 
plus auxiliaries) . Such a division into lower-order submo- 
dels increases the numerical robustness of optimal smooth- 
ing. First, it is shown that it is compatible with the 
SPIFR instrumentation system (described in detail in Appen- 
dix A) .. 

Rewriting the equations (2-9) and (2-10), 


1 


p 

• 

I 


6 

= s 

q 



r 


(3-1) 


where 



C0 

s6s4) 

S0C(|> 


I A 1 



-C0S(j> 


S = k 

0 

C0C(|) 

(3-2) 


0 

S(}) 

C<j) 
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The SPIFR experimental setup provides measurements of 
both the angular rates (p, q, r) and the Euler angles ® , 
\p) . As will be shown, this information plus the model in 
eq. (3-1) and (3-2) can be used to obtain optimally smoothed 
estimates of the angular states. These accurate estimates 
may then serve as inputs into the translational submodel . 


The "flat Earth" formulation of the translational submo- 
del, which is given with respect to the LLLN coordinate 
frame in Section 2.1, is widely used in aircraft dynamics 
simulations and analyses. For navigation problems, a 
three-dimensional state equation eq. (2-11), describing in- 
ertial velocity usually is employed; 



lain 




(3-3) 


The inertial platform mechanization is supposed to take care 
of the dynamic effects associated with Earth rotation and to 
provide continuously LLLN-referenced inertial acceleration 
measurements a^ . Ideally, 


^^irl 




2i 


(3-4) 


Corrections to position estimation Xj due to the kinematics 
of Earth rotation and geometry are then introduced algebrai- 
cally, following the optimal filtering, which operates on 
differential error equations. Other navigational applica- 
tions reconstruct position based on eq. (3-3), using "dead 
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reckoning" information and on distance measurements (Ref. 
31) . 

The outputs of the SPIFR experimental system include 
three-axes angular attitudes and rates, strapdovm body ac- 
celerations, aerodynamic angles, airspeed, altitude and dis- 
tances to navigational stations; this constitutes a self- 
contained body of information. As shown later in this 
chapter, appropriate processing of this information renders 
accurate estimates of flight path variables, yielding in- 
sight into both dyneimic and navigational effects. 

In order to achieve these objectives, the translational 
submodel must be generalized to include the effects of Earth 
rotation and geometry. Following Ref. 21, a set of spheri- 
cal coordinates is defined (Fig. 3.1) with respect to the 
Cartesian set of axes, whose origin is the center of the 
sphere; and ZgQ- axes are in the 0/180 deg-meridian- 
plane with z^,^ pointing upwards and x^^^ pointing towards the 
zero meridian. The Cartesian set is rotating about z^^ with 
fl= 0.728*10“^ rad/sec. The spherical coordinates are the 
latitude X , the longitude M , and the aircraft distance from 
the center of the sphere, R. 

Based on the above definitions, a relationship between 
the LLLN Cartesian and the spherical coordinates may be de- 
duced. 
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Figure 3.1: Earth Axes 




XR 

• 


• 


= 

mRcX 

• 


• 

L zj. J 


. -R 


Substituting eg. (3-5) into eg. (2-11), 


AR 

MRcX 
_ -R 




(3-6) 
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with the right-hand- side of eq. (3-6) being a vector, whose 
physical interpretation remains in the LLLN Cartesian coor- 
dinate frame. The starting point for the derivation of the 
relationship equivalent to eq. (2-2) is (Ref. 21), 




+ S 


- 


(3-7) 


where 




-(Hj3j^cX-Hj32S^) 


+(HfiicX-Hfi3sX) 


L+(H®2icX-H®23sX) -(H®3^3^ci-H®j^3Si) 


(3-8) 


and all other components as defined in Section 2.1. Imple- 


menting the kinematic relationship. 


(3-9) 


eq. (3-7) may be cast into the format of eq. (2-2) plus a 
set of "correction" terms. 


^ir = + 


Tj rsxcx 

+ -Elair - ; 

c X_ 


+ (2S + Wg)H®Wj (3-10) 
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Thus the generalized formulation of the translational 
submodel consists of eq. (3-6) and (3-10). Note that the 
strapdown accelerometers measure directly (a_ + 


h®2i ) • 


To avoid numerical difficulties and retain physical in- 
sight it is instructive to cast eq. (3-6) into the format of 
eq. (2-11), following the example of eq. (3-10). Define 
navigational-type state variables. 




aMcos(X^ + X ) 


(3-11) 


7 

where a = 2.094x10 ft is the semi-major-axis of the equator 
ellipse, is the latitude at which the test-flight begins, 
implying zero initial conditions at this point for x^ and 
y^. The quantities x^ and y^/cos ( X^+x^/a) are the naviga- 
tional coordinates X and /u with respect to the starting 
point (X^, M q) , scaled by the constant a. The definition in 
eq. (3-11) has direct bearing on the flight-test methodolo- 
gy, as X ^ and are inputs to the model and have to be 
known apriori . This constitutes no limitation, as the mis- 
sion may be initiated over a navigational "fix" such as an 
airport reference point or a VOR/DME ground station. In or- 
der to substitute eq. (3-11) into eq. (3-6), an expression 
relating Zj and R is required. Implementing the concept of 
the best-fitting sphere to the Earth surface at any point 
(Ref. 32), 
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R 


+ '’g 


(3-12) 


where p_ is the Gaussian radius of curvature, 

pQ = a Cl - 0.5e2cos2(X^ + X )1 (3-13) 

with = 0.0067 being the eccentricity of the equator 
ellipse . 


Substitution of equations (3-11) to (3-13) into eq. (3-6) 
renders. 




+ + Wj) 


(3-14) 


where 


«c = 




1-7 


-y^tan(XQ+X)4(l_.yj Vl_. 

L «^sin2(X^ + X )/i_y 0 


0 

OJ 


(3-15) 


with 


7 = 1 - (-z^ + Pp)/a 


(3-16) 


The associated distance measurement equation is. 


^si 


(x: 


+ y 2 . + zi. )"/2 


SI -‘SI 


SI ' 


(3-17) 


where 
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(3-18) 


Xgi=a(l-7)cos(XQ+X)cos(MQ+/i)-(-Zc+PG)siCXsiCMsi 
^si“^ ( 1 -T' ) cos ( Xq+ X ) sin ( M^+ u) - ( -z^+ Pq 


z .=a(l-7)sin( X +X) 
s jl o 


-<-“o+'’G>si='‘si 


with subscript si referring to the engaged DME stations. 


An important observation may be made comparing the gener- 
alized translational submodel with the "flat Earth" approxi- 
mation. Rewriting eg. (3-10) and (3-14), 


X 

— c 


+ Si + 

+ «I> 


(3-14) 


^ir 


Sb * ^ «?2i + 




sAcX 

0 


+ ( 2 w + Wp, ) H jWj( 3—10) 


The "correction" terms which follow the first lines of equa- 
tions (3-14) and (3-10), introduce state coupling between 
them. As will be elaborated, we can reconstruct first the 
vector and then, under the "flat Earth" assumption, the 
vector x^, implying lower-order more robust optimal filter- 
ing. This is no longer possible, in particular, as position 
estimation accuracy requires to add the wind vector Wj to 
the state vector. Still, the insight gained by this obser- 
vation contributed to efficient filter tuning, as shown in 
Section 3.3. 
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To summarize, the angular submodel (from now on referred 
to as "Model A") is given by equations (3-1) and (3-2); 
equations relevant to the translational submodel ("Model B") 
are (3-10) to (3-18), (2-3) to (2-8) and (2-12) to (2-18). 
Note that equations such as eq. (2-19) to (2-21) need not be 
used in the post-flight optimal smoothing and flight path 
reconstruction because the accelerations a^ were measured 
directly. 


3.2 THE OPTIMAL FILTERING AND SMOOTHING ALGORITHMS 

One way to extract measurement noise from experimental 
data is to pass each record separately through a filter 
which has been designed to meet an arbitrarily chosen cri- 
terion. The Butterworth filter is an example of such a de- 
sign (Ref. 33). Its analytical structure (low-pass) was 

hypothesized apriori and the numerical values of its coeffi- 
cients were obtained via parameter optimization. The chosen 
performance index, PI for this optimization was minimization 
of the least square error in following a step input, 

00 

PI = min of (l/T^«^dt (3-19) 

o 

The resulting filter chops off the high-frequency content of 
the recorded information for each data channel separately 
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and without accounting for the particular system's dynamic 
characteristics. 

The Wiener filter is a example of a filter design which 
incorporates the dynamic model of the physical system (Ref. 
34). Its formulation involves solving an integral equation 
(the Wiener-Hopf equation) through spectral factorization, 
which gives rise to practical implementation difficulties. 
These difficulties are alleviated by the Kalman-Bucy filter 
design (Ref. 35), which converts the problem of extracting 
experimental data noise into a solution of a differential 
equation. Its time-domain state-space structure is capable 
of "one shot" processing of measured time histories of sev- 
eral variables. Also, making use of the "built in" mathe- 
matical model of the system, it estimates variables which 
have not been measured directly. This includes measurement 
biases thus improving the overall estimation accuracy. For 
post-flight analysis, even higher accuracy may be achieved 
by accounting for the "future" information via optimal 
smoothing (Ref. 36 and 37). 

As the system mathematical model constitutes a key ele- 
ment in application of these algorithms, it is first restat- 
ed and then, its stochastic components are discussed. The 
general state equation, eq. (2-1) is. 


X = f(x, u) + w 


(3-20) 
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The measurement equation is , 


z = (3-21) 

The disturbances vector w in eq. (3-20) is referred to in 
the literature as "process noise". The vector v in eq. 
(3-21) is the "measurement noise". Both w and v were as- 
sumed to be "white" and to have a Gaussian (normal) prob- 
ability density distribution. 

As pointed out in Section 3.1, the SPIFR mathematical 
model may be split into lower-order models A and B. Pro- 
ceeding first with model A, equation (3-1) may be interpret- 

rri 

ed as its state model with [<^ ® constituting the state 

m 

vector and [p q r] being the input vector. This formula- 
tion prevents noise extraction from the angular rate infor- 
mation, which is used as an input to model B. In order not 

I 

to create such an inaccuracy effect, the state vector 
must be augmented to include p, q and r. 
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STATE MODEL A 


x' = 
-A 


P 

q 

R 


0 

0 

0 


p + (qs(j) + rccj)) tan0 
(qc4> - rs<t>) 

(qs<p + rc(p)/c9 

' y 

% 




(3-22) 


MEASUREMENT MODEL A 


2a = “a^^+^A (3-23) 

I 

The process noise vector reflects random and otherwise 
unmodeled effects, such as turbulence or engine-induced vi- 
brations. 


-A " "q (3-24) 

I 

The determination of the covariances associated with w^ is 
discussed in Section 3.3. The actual measurement noise vec- 
tor v^ is. 




Cnp nq Hj. n^ n^ n^]' 


(3-25) 
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The measurement vector in eq. (3-23) contains the meas- 

t 

ured values of x^. Thus the measurement model A is linear 

I 

and the observation matrix is a 6x6 identity matrix. 

In spite of the desire not to increase the order of the 
model, bias states (different errors and slowly varying gyro 
drifts) may need to be estimated. The flight test procedure 
was designed to minimize this effect. Careful calibration 
can provide practically error-free scale-factors. Allowing 
for sufficient warm-up time for the inertial sensors, their 
outputs were recorded while the airplane was stationary on 
the runway prior to takeoff and also in between missions, 
while the aircraft touched down and ran along the runway for 
about 25 sec, before getting again airborne. Mean values 
and standard deviations based on these data records were 
used to reduce the remnant measurement biases. For example, 
the angular rates have to be zero while stationary on run- 
way, and the Xg-y^ plane may be accurately levelled to ren- 
der zero values for pitch and roll angles. Unlike these an- 
gles which are measured with respect to the instantaneous 
LLLN tangent plane (continuous alignment with the local ver- 
tical), local North reference and heading drift errors may 
not be estimated apriori to a sufficient degree of accuracy. 
Thus, one more state must be added to Model A and eq. 
(3-22) and (3-23) have to be modified. 
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6x1 



1 1 



(3-26) 


(3-27) 


The bias, was modeled as a random walk process for the 
estimator. As pointed out in Ref. 38, there is a practical 
equivalence between the statistics of an exponentially-cor- 
related random process and a random walk process . The ran- 
dom walk model tends to result in slightly pessimistic fil- 
ter error statistics, which provides a safety margin. The 
random walk modeling approach is advantageous, because a 
single state variable can be used to model the sum of the 
bias plus long-correlation-time errors. This argument was 
also applied to wind and distance measurement errors in the 
context of Model B. 


Before presenting the equations of the filtering and 
smoothing algorithms, the appropriate formulation for the 
translational model. Model B, is now derived. It is assumed 
that having processed the angular information, the time-his- 
tories , 
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A A A ^ ^ ^ 

p(t), q(t), r(t); ^(t), ’/'(t) 

and the associated matrices, 

AAA 

Hj(t), H®(t), £3(t) 

are given. Based on equations (3-10) to (3-18), (2-3) to 

(2-8) and (2-12) to (2-18), model B may be recast as fol- 
lows : 

STATE MODEL B 





+ «c ‘“B^air ^ 5i) 



■ 0 

^ir 


“^air 1 

1 

^“E^^air - 

“sXoX 

0 

.c^X. 

+ (25 + Ug)HjWj. 

+ 

^ sB 

^B “l3-I 



0 . ' 
1 





0 

-Ki- 


0 1 

^ — 




J 


0 

" V 




MEASUREMENT MODEL B 


■ V ■ 


'(u^ + 

a 


tan"^ (w/u) 

0 

= 

tan”^(v/u) 

h 



-^si- 


,f(x^; eq.(3-17) and (3-18)) + b^^ _ 




(3-29) 
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The components of the wind vector Wj were appended to the 
state vector. The modeling of Wj was as a random walk pro- 
cess (Ref. 38). Following the pre-flight procedure outlined 
earlier in this section, the biases of the altitude, air- 
speed and aerodynamic angles were extracted apriori . The a- 
and 0-vane deflections are defined in body axes and may be 
calibrated accurately. A previous research effort deter- 
mined the correlation curves between the geometric vane de- 
flections and the actual aerodynamic angles (Ref. 39). The 
airspeed sensor was located so as to minimize the local flow 
effect and the calibration constants corrected for the rem- 
nant errors . The biases associated with the range measure- 
ments are of a more complicated nature. They depend both on 
inaccuracies associated with the individual DME stations and 
with the airborne interrogator. There are also weak time- 
dependent effects associated with the aircraft/station rela- 
tive geometry (Ref. 40). To account for the above, bias 7 
type states b^^ must be added to Xg/ they were modeled 
as random walk processes (Ref. 38). 

Vector Ug is an input to state model B. a^ consists of 
the acceleration measurements. The associated random meas- 
urement error vector n was included in the process noise 
vector Wg, along with the otherwise unmodeled turbulence ef- 
fects. Thus, all the components of Wg may have nonzero val- 
ues. The determination of the covariances associated with 
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Wg is discussed in Section 3.3. Note that both and Wg 
possess physically significant nonzero values. As pointed 
out in Ref. 41 and 42, presence of process-noise-free 
states in the system's model may cause the Kalman filter al- 
gorithm to diverge. The actual measurement noise vector Vg 
is, 


Zb = (3-30) 

Unlike Model A, for which the components were smoothed 
optimally, applied to Model B the Kalman filter reconstruct - 
ed components of Xg that were not measured directly. Exami- 
nation of equations (3-22) to (3-30) shows that both models 
A and B are nonlinear . Thus the Extended Kalman Filter 
(EKF) algorithm has to be applied (Ref. 37). Then, the op- 
timal smoother algorithm was implemented as a combination of 
forward- and backward- running Kalman filters. First the 
filtering algorithm is discussed and then the smoother equa- 
tions are presented, in a computationally-more-ef f icient 
formulation than the literally-forward-backward filter. 

The EKF algorithm constitutes an adaptation of the linear 
Kalman filter theory to nonlinear situations. It propagates 
the nonlinear dynamic model between measurements and uti- 
lizes a , locally-linearized model for the measurement up- 
dates. The discrete formulation of the EKF, which is a re- 
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cursive algebraic algorithm, was implemented in this 
research. It was applied to the dynamic model of a system, 
which consists of the state model (eq. (3-20)) and of the 
measurement 'model (eq. (3-21)). The propagation of the es- 

A 

timated states x and of the state covariance matrix P be - 
tween measurements uses. 


x(t) = f[x(t), u(t)] 


(3-31) 


and 


^k‘-> = + °k-l 

To minimize accumulation of inaccuracies, eq. (3-31) was 
propagated from to t^^ with a fourth-order Runge-Kutta 

numerical integration scheme (as in Ref. 23) and an inte- 
gration step of one twentieth of the time interval between 
measurements. At. The state covariance matrix P is propa- 
gated from its value P]^_i(+)» which is a post -measurement 
( + ) update at time step k-1, to the pre -measurement (-) 
value at time step k. Matrix is the process noise co- 

variance matrix. Assuming the process noise is white, 
is obtained from the diagonal matrix Q(t), which consists of 
the power spectral densities associated with the process 
noise vector (w^ in eq. (3-26) and Wg in eq. (3-28)). Using 
trapezoidal integration (Ref. 38), 
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^ 2*^k— 1 Q(^)] 33) 

Substituting eq. (3-33) into eq. (3-32), 

^k(") = ‘*’k-ll^Pk-l( + ) + 0.5AtQk_2]‘J>J_i + 0. 5AtQ(t) (3-34) 

Matrix <t> is the transition matrix obtained after local lin- 
earization of eq. (3-20) into, 

X = Fx + Gu + Lw (3-35) 

Although rigorously, 4> = = 2(FAt)^/il, Ref. 43 sug- 

gests that i^ppgj. = 36 is sufficient for all practical pur- 
poses. This was verified via the generic simulation de- 
scribed in Section 3.3. In order not to generate 
inaccuracies due to numerical differentiation, analytical 
derivation of the Jacobian matrices F, G, and L was carried 
out for both models A and B; this derivation is documented 
in Appendix C. Note also that in both models A and B the 
process noise w is additive, making the matrices G and L (in 
eq. (3-35)) identity matrices. This was used in eq. (3-32). 

The Kalman gain matrix is, 

"k = ”-36) 


3-20 



Matrix is the measurement noise covariance matrix associ- 
ated with measurement noise vector (v^ in eq. (3-27) and Vg 
in eq. (3-29)). Under the assumption that the measurements 
are uncorrelated white sequences, matrix Rj^ is diagonal. 
The observation matrix is obtained by local linearization 
of eq. (3-21) as, 

2k = “k2k + 2k <3-37) 

As the state equation Jacobians of eq. (3-35), Hj, was de- 
rived analytically for both models A and B (Appendix C) . 

The state and covariance propagation results are updated 
accounting for measurements, 

~ k “ (3-38) 

Pj^( + ) = [I - V3^]P,^(-) (3-39) 

Equations (3-31) to (3-39) represent the classical formu- 
lation of the Kalman filter algorithm. However, as pointed 
out in Ref. 42, this formulation may diverge numerically due 
to computer roundoff. The effects of numerical errors are 
generally manifested in the appearance of computed covari- 
ance matrices that fail to stay nonnegative-definite. There 
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are two distinct approaches to the solution of this problem; 
one is to improve on the classical filter formulation, and 
the other is to manipulate the weighted square-roots of the 
covariance matrices. The improvement of the performance of 
the classical formulation involves: 

* Periodic symmetrization of the off-diagonal terms of 
the covariance matrix (as in Ref. 38) by averaging; 

* Replacement of eq. (3-39) by the more general expres- 
sion, referred to as the "stabilized Kalman" algorithm 
(Ref. 44), 


P^( + ) = (3-40) 

An excellent comparison study between the two approaches 
is presented by Thornton and Bierman (Ref. 45). Their re- 
sults indicate that for single-precision applications (in 
particular, real-time filtering), the weighted-square-root 
or the U-D factorization update algorithm is superior in ac- 
curacy. However, when double-precision was employed, both 
approaches gave results that were practically identical. 
The difference in computer execution time also was insignif- 
icant. As the SPIFR post-flight analysis was conducted on 
an IBM 4341 computer that uses a double-precision FORTRAN 
compiler only, the symmetrized "stabilized Kalman" algorithm 
was implemented. 
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To summarize, the filter processing of the raw data 
provides the state and covariance estimates before and after 

A. A 

the measurement update, and X]^( + ), plus and 

P^(+). The smoothing algorithm derived below, requires 

storage of these filtering results. It uses this informa- 
tion as input; running backwards in time, it produces im- 

A 

proved estimates of the states, snd of the covariance 

matrix, P, , . 

k/n 

At least three types of smoothing algorithms can be con- 
sidered. Fixed-point smoothing is concerned with achieving 
smoothed estimates of a signal for some fixed point k; 
fixed-lag smoothing introduces a fixed delay between signal 
reception and the availability of its estimate; fixed-inter - 
val smoothing is mainly concerned with off-line smoothing of 
experimental data. The latter is the most appropriate for- 
mulation for accurate post-flight flight path reconstruc- 
tion. Following the classical work by Rauch, Tung and 
Striebel (Ref. 46), who developed the sequential algorithms 
for discrete-time optimal smoothing, several other research- 
ers looked into the fixed-interval smoothing problem (e.g.. 
References 47, 48 and 49). Bach (Ref. 49) based his ap- 

proach on variational minimization of error; Fraser's (Ref. 
47 ) important contribution is the derivation of the smooth- 
ability condition, which reduces computational cost without 
compromising the smoothing accuracy. The formulation by 
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Rauch, Tung, and Striebel was implemented in the present re- 
search. It does not require the use of the original data 
records plus the measurement equation (whose parameters have 
to be continuously recomputed in the nonlinear case) -also 
through the smoothing pass. Fraser's smoothability condi- 
tion also was applied. 

The first step is the computation of the state matrix F^, 

A 

F^ = f[XT^( + )3 (3-41) 

The state matrix F^^ is used to calculate the state tran- 
sition matrix (see comment following eq. (3-35)). The 

state transition matrix and the input covariance matrices 
render matrix 


A A 

Using the input state estimates 

associated covariance matrices P^^(-) and P]^( + ) along with 
A^, the smoothed and reconstructed states Xj^/^ are ob- 
tained. 


-k/n " ^k^^i^k+l/n “ i^k+1^"^^ 

with 
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(3-44) 


2En/n = + ^ 

The accompanying covariance matrix is given by. 


^k/n “ ^k^^^k+l/n “ ^k+l^"^^^k 


with 


^n/n 


Pn( + ) 


(3-46) 


This algorithm, which performs post-flight data smoothing 
and flight path reconstruction, was coded in FORTRAN (Ref. 
17). The optimal filter was tuned using a trajectory simu- 
lation, and the efficiency of the smoother was improved, ap- 
plying the smoothability condition (Ref. 47). These activi- 
ties along with implementation of the optimal estimation 
algorithm to actual SPIFR flight-test data, are reported in 
the next section. 
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3.3 FILTER TUNING AND IMPLEMENTATION OF THE OPTIMAL FLIGHT 
PATH RECONSTRUCTION ALGORITHM 


The required inputs for the optimal flight path recon- 
struction algorithm are the measured time series and the 
driving noise statistics Q and R. In most cases, estimates 
of the measurement noise -covariances , R^ can be derived from 
the sensor manufacturers' specifications. The more diffi- 
cult problem is the determination of the elements of the ma- 
trix Q(t), because they have to reflect the system's model- 
ing uncertainties along with the actual process noise; this 
problem is referred to as filter tuning. 

As pointed out in Ref. 50, the steady-state dynamic re- 
sponse properties of the Kalman filter may be deduced from 
the eigenvalues of the estimation error differential equa- 
tion; an example of this is presented by Bryson and Widnall 
for a baro-inertial altitude estimator (Ref. 51 and 52). 
They show that these eigenvalues of the steady-state optimal 
estimator are functions of the ratios of elements in the 
spectral density matrix of the state-driving noise, Q(t) and 
in the spectral density matrix of the measurement noise, 
R(t) . Thus the Q matrix elements may be perceived as filter 
design parameters, and the R matrix is given apriori, as 
mentioned at the beginning of this section. 
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Before discussing the filter tuning methodology and the 
criteria for an appropriate choise of the elements of Q, it 
should be kept in mind that the above argument rigorously 
applies only to the steady-state optimal estimator case. In 
this case, where system and measurement dynamics are linear 
and time-invariant and the driving noise statistics are sta- 
tionary (Q, R are not functions of time), the filtering pro- 
cess may reach a "steady state" wherein the state covariance 
matrix P is constant. For this to happen, the complete ob- 
servability and controllability conditions must be fulfilled 
(Ref. 37). Then, introducing P = 0 into the continuous- 
time Riccati formulation, important physical insight may be 
gained, 

FP + PF*^ + Q - Ph'^R“^HP = 0 (3-47) 

In this steady state, the rate in which uncertainty builds 

up, Q, is just balanced by the rate at which new information 

T —1 

enters the system, PH R HP and the system dissipation due 
to damping (expressed in F) . Although the SPIFR dynamic 
model is nonlinear and time-varying, the numerical values of 
the elements of the linearization Jacobians are bounded and 
vary slowly with time. Thus, appropriate tuning may render 
a practically steady-state filter performance. 
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The filter tuning process consisted of two distinct 
steps: (a) initial choise of numerical values for the Q-ele- 
ments, and (b) iterative procedure of convergence to their 
final values, which satisfy certain performance criteria. 
This iterative procedure involved repeated implementation of 
the EKF algorithm to simulated data records, which were cre- 
ated by a flight path generation computer program (Appendix 
D) . The input options to this generic flight path simulator 
included the effects of low-frequency wind gusts and of bi- 
ases, plus random measurement errors and disturbances. The 
pseudo-random- number generator, which creates the Gaussian 
probability distribution (Ref. 53), produced a point every 
50 milliseconds for each variable. As in flight testing, 
actually used were the points corresponding to the A/D sam- 
pling instances (Appendix A) . This computer code rendered 
both the nominal noise-free trajectory and the corrupted 
data records. The acceptability of a set of values for the 
elements of the matrix Q was judged by comparing these simu- 
lated data records to the time histories obtained by filter- 
ing and then smoothing the corrupted data. Quantitatively, 
measurement residuals were compared with the estimated 
states' covariances, as will be shown later in this section. 

The filter was tuned with a 60-sec straight flight path 
segment (Fig. 3.2); then its performance was verified with 
a coordinated climbing turn maneuver (Fig. 3.3). The lat- 
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ter may be interpreted as a holding pattern maneuver, which 
is characteristic of SPIFR flight and which contains larger 
parameter variations. The asteriks (*) in Figures 3.2 and 
3 . 3 denote the locations of the navigational ground sta- 
tions, which provide range and azimuth information. The nu- 
merical values in both are the inputs to the generic simula- 
tion. They were obtained via a steady-state (equilibrium 
flight conditions) analysis. Both figures are schematic 
horizontal projections of the flight trajectories, referring 
to the nominal (bias- and noise- free) cases. 


The following measurement noise standard deviation values 
characterise the sensors employed in the research. They are 
based on manufacturers' data and were verified after inte- 
gration into the experimental setup, as described in Section 

3.2. 


a = ff = <r 
p q r 


0.15 deg/sec T 




= 0.15 deg 


(3-48) 
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- 500FT, - 12S.6FPS, - 0. - 5.5°, 

^ .i)..p.q-r-ay-0. a^- 0.096"g", a^ - -0.994"g" 
Figure 3.2: Longitudinal Flight Path Segment 


hjj - 116FT, - 125.6FPS. y^ - 4.5°. 6^^ = 10° 

^ • 12.7°, 'I'q • a^ « 0, p • -0.5°/SEC, q “ 0. 

r • 2.86°/SEC, a^ - 0.179"g", a^ = 1.003"g" 
Figure 3.3: Coordinated Climbing Turn 
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j 
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These values were used with the random-number generator in 
the generic simulation and with the measurement covariance 


)°/SEC, 
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matrix in the optimal filtering algorithm. As pointed out 
in Section 3.2, and were interpreted as part 

of the process noise covariance matrix. 

The value of in eg. (3-49) is based on eq. (2-98) in 

conjunction with the anticipated range of DME distance meas- 
urement values from points on SPIFR trajectories (Fig. 2.4 
to 2.7) to the ground stations engaged in the flight tests 
(the detailed list of the stations' coordinates is given in 
Appendix D) . The DME stations' bias was assumed to be 
500 ft (Ref. 31), and the value of 1.5 deg was taken for the 
directional gyro error, b^. 

Starting with the actual tuning for model A, the initial 
choice of the numerical values of the Q-elements has to be 
made. One may observe from eq. (3-22) that the state vec- 
tor x^ consists of body angular rates and of Euler angles. 
With regard to variations in the Euler angle states, higher 

time constants are involved and the low-frequency range is 

. 2 2 2 

of interest. Thus , <r^ and of eq. (3-48) must be high- 
er than the respective Q(t) -elements . On the other hand, 
the latter should not be too low, as this would mean that 
the angle measurements are of relatively poor quality and 
should be ignored, instead of being used in an optimal fa- 
shion. As an initial choice, values of measurement covari- 
2 2 2 

ances, <r , <r and were taken. 


3-31 



In contrast with the Euler angle states, a 
higher-frequency range is of interest with regard to the an- 
gular rate states. Covariances a“^ , and may not be 

higher than the respective Q(t) -elements . This also is due 
to the frequency cj -weighting in power spectral densities of 
these Q-elements (Ref. 54). On the other hand, they should 
not be too high, as this may prevent filtering out the 
high-frequency measurement noise. The SPIER research, in 
particular, focused on the low-frequency dynamic response 
and even the "short-period" frequency range (about 2 cps ; 
Ref. 21) is irrelevant. This frequency-domain line of rea- 
soning renders trends of variation for the filter tuning it- 
erations . 

The results of the tuning of the optimal filter for Model 
A are summarized in Table 3.1. This table represents the 
translation of the theoretical Q-versus-R tuning reasoning 
into a practical implementation procedure. Given the R^ nu- 
merical values (column 2), values for Q (column 6) were cho- 
sen and the optimal filtering and smoothing algorithms were 
applied. Along with the filtered and smoothed state vari- 
ables' time histories, the respective covariance matrices 

A A 

?£ and Pg are tabulated (columns 4 and 5). Comparison of 
their diagonal terms shows the improvement over filtering 
gained by smoothing. To complete the analysis of the ef- 
fects of the particular Q-elements tuning choice, the sta- 
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tistics of actual measurement residuals was used to obtain a 


quantitative filter performance criterion. The vector of 
measurement residuals, Az is given by. 


Az = z - h(x) (3-50) 

A 

2 

The mean square values of ^i (column 3 in Table 3.1) 

are. 


A 

^2 . 
zi 


Z ( AgAg' ^)^j^/(N-l) 


(3-51) 


Following the argument at the beginning of this section, we 
want to avoid both. 


<r 


2 

zi 


<< R. 


kii 


11 


= R. 


kii 


(3-52) 


and 


zi 


= R 


kii 


11 


<< R 


kii 


(3-53) 


should be avoided. In the first case the algorithm performs 
measurement-following and in the second, it imposes heavy 
filtering, minimizing the measurement input. The objective 
is to filter out the noise without “filtering out" the actu- 
al information along with it. Sets of results as the one of 
Table 3.1 were complemented with visual inspection of nomi- 
nal- versus-corrupted-versus-filtered-versus-smoothed time 
histories (examples are given at the end of this section) to 
decide on the final numerical values for the Q-elements . 
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TABLE 3.1 


Filter Tuning Results for Model A 


STATE 

VARIABLES 

MEASUREMENT 
COVARIANCES 
(DIAGONALS OF Rj^) 

KEASUREKEHT 

RESIDUAL 

COVARIANCES 

FILTERED STATE 
COVARIANCES ^ 
(DIAGONALS OF P^) 

SMOOTHED STATE 
COVARIANCES 
(DIAGONALS OF P^) 

PROCESS NOISE 
POWER SPECTRAL 
DENSITIES 
(DIAGONALS OF Q) 

p 

7,0 X 10** 

3.8 X 10** 

4.5 X 10** 

3.8 X 10** 

9.0 X 10** 


-6 


-6 

-6 

-6 


7.0 X 10 

2.0 X 10 

4,5 X 10 ” 

3.8 X 10 

4.0 X 10 

T 

7.0 X 10** 

3.8 X 10** 

4.5 X 10** 

3.8 X 10** 

9.0 X 10** 




-ft 

•6 

•fl 


7.0 X 10 ° 

4.S X 10 ” 

4.5 X 10 ° 

3.8 X 10 

0.5 X 10 

e 

7.0 X 10** 

3.1 X 10** 

4.5 X 10** 

3.8 X 10** 

0.5 X 10** 


7.0 X 10** 

5.2 X 10** 

4.5 X 10** 

3.8 X 10** 

0.5 X 10** 


The last state variable, with respect to which Model A 
remains to be tuned, is b^ (eq. (3-26)). As there was no 
direct measurement associated with the estimation of b^^, the 
iterative procedure was employed. As a result, 

Q(t)b^ = Q77 = 2 . 5 X 10 "^ (3-54) 

The penalty for the need to estimate b^ was some reduction 
in the accuracy of the estimation of ^ itself. However, as 
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obvious from eq. (3-22), this did not affect practically the 
estimation of the other state variables of model A, as the 
yaw angle is an "open- loop" navigational variable. 

Finally, the smoother algorithm of equations (3-41) to 
(3-46) was applied to the original 6x6 bias-free mathemati- 
cal model of eq. ' (3-22) and (3-23). Although strictly 
speaking, the smoothability condition (Ref. 47) applies only 
to process-noise-free constants, it was verified that one 
may increase robustness by order reduction with practically 
no accuracy penalty. 


To proceed with the dynamic tuning for model B, the "cor- 
rection" terms in eq. (3-28), which constitute a weak 
coupling between the flight dynamics and the navigational 
submodel, are omitted. Thus, equations (3-28) and (3-29) 
may be partitioned as follows. 


SUBMODEL 

B1 




iiBl 


(3-55) 
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• («2 + + w2)V2 ■ 
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a 
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tan”^ (w/u) 
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tcin~^ (v/u) 




(3-56) 
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and 
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+ iiB2 (3-57) 
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Submodel B1 is self-contained. To gain more insight, one 
may equivalence, in an approximate sense, the measurement 
equations to direct measurements of states (as for Model A). 
Assuming the angles of attack and of sideslip to be small 
angles, which holds for the SPIFR flight regime. 


V 

= u 




OfU 

0u 

= w 

= V 

4 

>■ 

(3-59) 
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Variations in u would affect the a and /3 measurements less 
than variations in w and v, respectively. For an airspeed 
of 125 fps, e.g., and values of and from eq. (3-49), 
the equivalent and are. 


<r = ff = 125x0.30x0.01745 = 0.65 fps (3-60) 

w V 


and. 


(3-61) 

*^ax = *^ay " *^az = 0.02"g" = 0.64 ft/sec^ (3-62) 

Variations in u correspond to a lower frequency range than 
variations in w or in v. This gives a lead for the frequen- 
cy-domain line of reasoning. Recall that the measurement 
noise associated with the accelerometers' outputs is inter- 
preted as a component in the process noise vector Us- 

ing the values in eq. (3-62) as a starting point, it may be 

expected that numerical values of a and <r would need to 

ay az 

be increased more (with respect to a and <r ) than that of 

w V 

*^ax respect to ^ • To complete the tuning for submo- 

del Bl, the iterative procedure must now be employed. Be- 
fore citing the results, a practical implementation issue, 
which may affect the final tuning results, is now referred 
to. 
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As described in Appendix A, an averaging scheme for 
onboard compaction of fast variables (angular rates, linear 
accelerations and aerodynamic angles) was chosen. It is 
well known (e.g., Ref. 37) that such an approach may result 
in performance degradation of the Kalman filter due to in- 
troduction of nonwhiteness and correlation into the measure- 
ment noise sequence. However, the time interval in the av- 
eraged sequences was about an order of magnitude lower than 
the time constant of interest. Thus, the whiteness approxi- 
mation is justified. With regard to the time correlation 
introduced into the measurements, its effect is mainly to 
increase the noise level relative to the reduced measurement 
noise, «^y/n (n is the number of averaged measurements). 
This additional noise depends on the statistical properties 
of the state variables associated with those measurements. 
The solution implemented by Schmidt etal(Ref.55) was to in- 
troduce first-order shaping filters with white noise inputs . 
As already pointed out, an alternative solution may be to 
tune for an equivalent noise level without changing the mod- 
el structure. As a guideline, the equivalent noise level 
may be expected to be within the following bounds: 


aV(n-l) < al < al (3-63) 

— —equivalent — 

Applying the powerful tuning methodology, which regulates 
the Q/R ratio, the filter performance degradation may be 
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minimized. This was verified via numerous Monte-Carlo-type 
runs (Ref. 56), although this was not an extensive Monte- 
Carlo analysis. Final tuning of submodel B1 rendered. 


‘"w *^v ' 0-49 fps or 
Q(t)^^ = 0.81 

With regard to model A, the 
solved by small readjustments 
numerical values in Table 3.1 


<T^ = = 0.23 deg (3-64) 

(3-65) 

averaging scheme 'problem was 
of the Q-matrix elements. The 
account for this effect. 


m 

The state vector [u v w] , which was reconstructed via 
submodel Bl, is used now to prepare the deterministic forc- 
ing vector u(t) - for the tuning of submodel B2 (eq. (3-57) 
and (3-58)). One may observe from eq. (3-57) that assuming 
concurrent distance measurements (for tuning purposes) and 
under zero-wind conditions, the submodel B2 simplifies to 

static estimation of [x^ y^ b^^^ ^s2^*^ ^B2“® ^“^32“^ ^ * 
Thus, wind modeling is responsible for the filter dynamics. 
Applying the -^^ ( [sI-F]~^ ) algorithm and using matrix parti- 
tioning and block diagonalization (Ref. 22), the state 
transition matrix is obtained (At=l.sec), 


<t> = 


I f I I 0 

3x3 [ 3x3| 3x2 

, J 


L 0 

5x3 


I 

I 


I 

5x5 


= const . 


(3-66) 
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The only state which is directly measured in this submo- 
del is z^; thus its tuning is practically uncoupled from the 
other two states. The latter, x and y^, are related to the 
range measurements and consistently with eq. (3-49) the 
fine-tuning renders, 

(3-67) 

~c c 

The tuning results for model B up to this point are summa- 
rized in Table 3.2. 


Q(t)„ ^ = Q(t) y = 100 

c ^c-'c 


Q ( t ), , = 6 


TABLE 3 . 2 

Filter Tuning Results for Model B 


STATE 

VARIABLES 

MEASUREMENT 
COVARIANCES 
(DIAGONALS OP R^) 

MEASUREMENT 

RESIDUAL 

COVARIANCES 

sizi 

FILTERED STATE 
COVARIANCES 
(DIAGONALS OF P^) 

SMOOTHED STATE 
COVARIANCES ^ 
(DIAGONALS OF P, ) 

PROCESS NOISE 
POWER SPECTRAL 
DENSITIES 
(DIAGONALS OF Q) 

V 

1.00 

0.36 

0.16 

0.09 

0.81 

a 

0.000016 

0.000012 

0.000009 

0.000008 

0.81 

6 

0.000016 

0.000012 

0.000009 

0.000008 

0.81 

h 

16.0 

8.0 

6.3 

5.3 

36.0 

♦ 

^ sl , s 2 

360000 

300000 

62500 

57600 

10000 
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with respect to the remaining wind and DME error states, 
which were modeled as random walk processes, the tuning was 
done via the iterative procedure . As mentioned earlier in 
the section, the range biases may be about 500 ft and the 
winds-up to 40 knots. The values of the Q elements corre- 
sponding to the distance measurement errors were determined 
to be 10 . With regard to the wind estimation, the W com- 
ponent was assumed to be negligible, within the low-frequen- 
cy range of interest. The coordinate was measured di- 
rectly and, as verified using the generic simulation, the 
effect of W on position accuracy is insignificant. Unlike 
the (z , W_)-pair, x_ and y_ may be expected to be sensitive 

to W and W accuracies, in particular as the wind ampli- 
X y 

tude range is large . A way to cope with the problem is to 
use the iterative process to obtain the functional relation- 
ship between the wind gust level and the respective Q-ele- 
ments (Fig. 3.4). Then, using this relationship and the 
meteorological data, neimely wind magnitudes W^^ and W^^ at 
flight-test altitudes, the Q elements for a specific post- 
flight trajectory reconstruction may be determined. 


The position uncertainty may be represented by an ellip- 
soid, whose half-axes are the square roots of the diagonal 
elements of the state covariance matrix P^. This ellipsoid 
is flattened in the z^ direction, as the state is meas- 
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Figure 3.4: Filter Tuning for Wind Estimation 


ured directly and with a high degree of accuracy. As men- 
tioned following eq. (3-49), and depend on the geom- 
etry of the ground stations with respect to the aircraft 
(e.g., on distance and on the GDOP effect) and may not be 
equal to each other. Moreover, the filter will render dif- 
ferent and as a function of the wind intensity lev- 
el, when it is tuned for a range of distances (Fig. 3.4). 
In a different context, it has been shown that a wind of 40 
knots may degrade the accuracy of position estimation by 
about 10% (Ref. 57). Thus, for best results, the post- 
flight flight path reconstruction procedure should be inter- 
active and should account for gross variations in distances 
and in wind intensity. 
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The tuning procedure involved several practical implemen- 
tation issues, such as the switching to a new pair of DME 
stations and the rare interference of the Morse code sent 
out by the tuned-in ground stations every thirtieth of a 
second. Both occurences caused an abrupt saturation of the 
DME data channel. This is an outlier (or "wild point") 
problem, i.e., data not due to the physical system's re- 
sponse. As pointed out in Ref. 58, automatic wild point 
editing schemes may distort the good data. However, due to 
the high gradients associated with the abrupt channel satu- 
ration, the problem could be readily detected, and the last 
good measurement was extrapolated to obtain estimates of the 
flight path variables. When the switching to a new pair of 
stations was completed, a hexidecimal code which identified 
the new station combination was entered into a specially 
dedicated data channel (Appendix D) . Based on this informa- 
tion, time vectors of station engagements were prepared for 
input to the filtering program. When the computation 
switched to a new pair of navigational stations, the off-di- 
agonal elements of the covariance matrix were reset to 
zero (Ref. 31). An example of a case where a large discon- 
tinuity in a data channel is physically significant is the 
change of the yaw angle at the 0/360 deg point; the val- 
ue of the state variable was shifted accordingly with no co- 
variance resetting . 
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Examples of the optimal flight path reconstruction algor- 
ithm's application to the generic flight-test data records 
are given in Fig. 3.5 for the coordinated climbing turn of 
Fig. 3.3. Plots (a) to (f) of the figure present recon- 
structed measurements, demonstrating both state variable re- 
construction and improvement with respect to data corrupted 
by noise. The symbol convention used in these plots is; (+) 
for nominal, (□) for corrupted, (V) for filtered and (A) for 
smoothed time histories. Line segments are used to link re- 
sults but they do not imply a functional relationship.^ 

Plots (a) and (b) represent the optimal smoothing of the 
angular states. As may have been expected, the "derivative" 
states (e.g., (b) ) are noisier than the "integral" states 
(e.g., (a)). This distinction may also be applied to the 
airspeed versus aerodynamic angle measurements, which re- 
flect the atmospheric turbulence effect. As follows from 
the translational submodel formulation, to reconstruct these 
measurements (e.g., plots (c) and (d)), the states u, v and 
w were first estimated. The typical lag introduced by fil- 
tering is more apparent in some of the figures; it is then 
reduced by the smoother. The trajectory reconstruction is 
represented in plots (e), (f) and (g) . Note that optimal 
smoothing improves the filtered state estimates and also 
shrinks the position uncertainty ellipsoid. 

^ In this program run both range measurements were assumed 
to be obtained (and corrupted) every second. 
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Examples of the optimal flight path reconstruction algor- 
ithm's application to a segment of the flight of September 
17th, 1981 are presented in Pig. 3.6. As these are actual 
data, the nominal ( + ) flight path time histories knovm for 
the generic simulation, do not appear in the plots. The 
translational results are presented for the complete model 
B; thus the x(y)-trajectory tracings are scaled geographic 
coordinates (^, #* ) variations with respect to the flight 
starting point (^q# meteorological wind informa- 
tion (6 knots/50 degrees azimuth) was implemented appropri- 
ately. Approximate values for the initial conditions of the 
state variables were deduced from the prepro- 
cessed results . The engaged DME stations for the shown 
flight segment were Robbinsville and Colts Neck (see Table 
D.2). As expected following the pilots' report, the flight 
path variables' time histories reflect strong turbulence 
conditions. This is particularly evident as entering a 
holding pattern the aircraft has been turning in this flight 
segment. Results of the processing of the mission data of 
September 17th, 1981 verify the SPIFR flight path recon- 
struction concept. 

With regard to the reconstruction of the trajectory hori- 
zontal projection, note that the performance of the DME/DME 
scheme is inherently limited by the GDOP effect. As elabo- 
rated in Chapter 2, the SPIFR mission planning minimized 
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this adverse effect intentionally. Thus, the accuracy of 
position estimation, achieved in our experiments is more 
than adequate for allocation of the flight segments, for 
performance indicators computations. For more accurate po- 
sition estimation the multiple DME scheme (with redundant 
measurements) should be employed. This will reduce signifi- 
cantly the sensitivity both to the GDOP, to DME biases and 
to the wind effects . To demonstrate the potential position 
accuracy attainable, when going to multiple (redundant) DME 
realization, a DME/DME/DME case study is explored analyt- 
ically in Appendix C.3. It is shown that improvement up to 
30% in position accuracy with respect to the results in Ta- 
ble 3 . 2 may be achieved . 
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a) PITCH ANGLE SMOOTHING (SEPT. 17, 1981) 



TIME-SEC 


Figure 3.6; Application of the Optimal Flight Path 

Reconstruction Algorithm to Actual Flight-Test 
Data 
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c) TRUE AIRSPEED RECONSTRUCTION (SEPT. 17, 1981) 











TIME-SEC 


Figure 3.G; Application of the Optimal flight Path 

Reconstruction Algorithm to Actual Flight-Test 
Data (cont'd) 


OHIO 


d) ANGLE-OF-ATTACK RECONSTRUCTION (SEPT. 17, 1981) 



TIME-SEC 


Figure 3.6; Application of the Optimal Flight Path 

Reconstruction Algorithm to Actual Flight-Test 
Data (cont'd) 
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As an additional concept verification, a closer look was 
taken at the mission starting point (X^, n for the 

first eleven SPIFR flights, which was defined by an inter- 
section of two VOR radials under ideal GDOP conditions. In 
all these missions the same IFR-experienced test pilot 
performed the navigation to this starting point. 

The coordinates of the starting point were obtained 
for each flight using the flight path reconstruction algor- 
ithm with DME range measurements to the seime navigational 
stations. The dispersion of the points is shown 

in Fig. 3.7. The standard deviations are, 

= 1700 ft .(3-68) 

^aycosx “ 2850 ft (along-track position estimation 

is more affected by delays in ' 
data acquisition system triggering) 

Note that with regard to the flight path reconstruction 
algorithm, the computation of the points ^ oi^ consti- 

tutes a static estimation (t = 0), whose accuracy based on 
eq. (2-97) is, 

*^DME/DME ~ 1.414<^/sfl = 0.14nm = 850 ft (3-69) 

as determined from Fig. 3.8 for d = 90 deg. From eq. 
(2-96) and Fig. 3.8, the VOR/VOR error is. 
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Figure 3.7: Starting Point Dispersion for the First Eleven 

SPIFR Tasks 

= 3830 ft (3-70) 

These results indicate that the VOR/VOR system onboard the 
ARA was functioning within specifications (eq. (2-98)). 

To conclude this chapter, several samples of optimal tra- 
jectory reconstruction results (horizontal projections) for 
complete SPIFR missions are presented in Figures 3.9 to 
3.11. The plus symbols in the figures provide the time di- 
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Figure 3.8: Aircraft-Navigational Stations Geometry for the 

Starting Point for the First Eleven SPIFR 
Missions 

mansion; they are 50 sec apart. Comparison of these figures 
to Figures 2.5 to 2.7 shows that due to the minimum-GDOP de- 
sign, the actual navigational tracks, although flown with 
the less accurate VOR/VOR mode, did not diverge significant- 
ly from the respective planned variants. The accuracy of 
flight path reconstruction is demonstrated in these plots by 
the alignment of the trajectory starting point with the 
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glide slope or the runway direction. Recall that the data 
acquisition system was being initiated over Forrestal air- 
field reference point; also, the x-y axes set is the scaled 
North-East ( latitude- longitude) navigational grid. As 
pointed out in Qiapter 2, different altitude and airspeed 
profiles have been planned for each track variant. A sample 
of such profiles is presented in Fig. 3.12 (again: the "+" 
and "x" are 50 sec apart) . The time histories in this fig- 
ure are results of optima'l smoothing processing and the im- 
pression of high-frequencies content in the airspeed varia- 
tion is due to the large time span (over 30 min), which is 
required to simulate a realistic SPIFR mission. Time histo- 
ries of this type are used in the next chapter to find out 
how well could the pilot hold altitude or airspeed with a 
given configuration. 
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3.9: Reconstruction of a Navigational Trajectory 

Second Variant 
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FLIGHT 4 DAT 7 MONTH 5 TERR 1982 
CONFIGURATION 10 PILOT 1 TRACK 2 

Figure 3.12: Reconstruction of Airspeed and Altitude 

Profiles for a Complete SPIFR Task 



Chapter 4 


STATISTICAL ANALYSIS AND DERIVATION OF FLYING 
QUALITIES CRITERIA FOR SPIFR OPERATIONS 

The message in Fig. 4.1 is that Chapter 4 constitutes a 
focal point of the SPIFR program. It uses as "inputs" the 
"outputs" of Chapters 2 and 3, and applies statistical pro- 
cessing to these "inputs". As a result, the first objective 
of this research, which is deduction of flying qualities 
criteria for SPIFR operations, is achieved. 

Section 4.1 elaborates on the principles of the multiple 
regression analysis. A detailed discussion of the analyt- 
ically-derived candidate criteria was given in Chapter 2. 
They may be reflected in "subjective" Pilot Opinion Ratings 
(PORs) and "objective" performance indicators, which were 
computed in Section 4.2 (using the algorithm of Chapter 3). 
Results of actual implementation of the stepwise multivari- 
ate regression algorithm to the SPIFR data-base are present- 
ed in Section 4.3. 
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Figure 4.1: SPIFR Research Flow Chart 










4.1 THE MULTIPLE REGRESSION ALGORITHM 


In this section the multiple regression analysis, which 
is used to deduce the SPIFR flying qualities criteria, is 
discussed. The discussion is based on the excellent statis- 
tical text of Ref. 59. 

Several flight tests were performed with each of the n 
chosen aerodynamic configurations. As shown in Chapter 2, 
each configuration may be characterized by various candidate 
criteria. Following an extensive theoretical study p such 
candidate criteria were chosen. The purpose of the regres- 
sion analysis was to single out statistically significant 
SPIFR flying qualities criteria from the candidate criteria 
"pool". This may be done by evaluating the latter versus 
performance indicators, which constitute the experimental 
results. Such statistical evaluation of each performance 
indicator vector against the "pool" of the candidate cri- 
teria is referred to as multiple regression. 

The target relationship between a performance indicator 
vector, £, and the candidate criteria matrix, [xj , is: 

£ = [x]^ + u (4-1 ) 
where the experiment-based vector ^ is. 


4-3 



(4-2) 


= Cyi ^2 

The vector of partial regression coefficients, is: 

^ h »2 ^rf 

The regression error vector, u, is: 


^ = Lu^ U2 (4-4) 


In the following definition 



the columns of matrix [x] (excluding the first column), or 
the candidate criteria vectors x, to x , consist of the nu- 

-1 -p' 

merical values for each configuration, with x^q = 1 for all 
i. The length of these vectors, n, is equal to the length 
of the vector of indicators If one data point is 

available for each configuration, then n is also the number 
of configurations considered. Due to configuration replica- 
tions or to several segments of same nature in one flight. 
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there may be different numbers of data points for different 
configurations. In such a case n can be larger than the 
number of in-flight-simulated configurations. Note also 
that there may be another reason for repeated values in a 
column of [x], due to the fact that a configura- 

tion change does not affect a given criterion. For example, 
a change in does not affect the total damping coeffi- 
cient and it will remain identical to the nominal value. 

Assumption that the components of u are random quantities, 
independently distributed with zero mean and constant vari- 
ance v (Gaussian probability distribution), renders; 

E(u) = 0 (4-6) 

var(a) = E(uu'') = (4-7) 

Equations (4-1), (4-6) and (4-7) yield the vector of the ex- 
pected values of the observations or of a given performance 
indicator, 

E(2) = [x]^ (4-8) 

By minimizing the sum of squared deviations of the observa- 
tions from their expected value, the least squares estimator 
of b is obtained, 

b = (Cx]'^Cx])-^[x]'^X (4-9) 
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is usually referred to as the intercept. A vector of 
fitted (or predicted) values ^ may be now defined as, 

A 

2 “ Cx]b . (4-10) 

The vector of the observed residuals e, is then given by, 

A 

e=2“£ = 2” (4-11) 

The percentage of variation explained by the model is given 

2 

by the square of the multiple correlation coefficient R , 

^ A _ 

r 2 = [l-2(yj^-y^)2/s(y^-y)2]ioo% (4-12) 

where 

y =2yj^/n (4-13) 

Note that this discussion is not restricted to linear rela- 
tionships in the simplistic sense. Following a first look 
at the data in a scatter plot, one may decide, for example, 
that a performance indicator is a linear function of the 
square root of the fourth candidate criterion. This ap- 
proach is referred to as "transformation of variables" and 

can be practiced, exercising care with the underlying analy- 
sis assumptions. 

A way to verify the regression analysis results is by hy- 
pothesis testing. The most commonly investigated hypothesis 
starts out assuming that all regression coefficients (except 
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for the intercept /3 are zero. This implies that there is 
no linear relationship between the dependent variable and 
the set of independent variables. The test involves a com- 
parison of the goodness of fit that is obtained when using 
the full model with the data, to the goodness of fit that 
results using the = 0 (i>l) assumption specified by the 
null hypothesis. If this assumption gives as good a fit as 
the full model, then the null hypothesis is not rejected. 
As the first step of the procedure, the sum of squares due 
to error associated with the full model by SSE(FM), is writ- 
ten as, 

SSE(FM) = 2(y^-y^)2 (4-14) 

SSE(FM) represents the lack of fit in the data associated 
with the model. The lack of fit in the data which is asso- 
ciated with the null hypothesis assumption is denoted by 
SSE(RM), 

SSE(RM) =2(y^-y)^ (4-15) 
The ratio F, 

F = [SSE(RM)-SSE(FM)3 (n-p-l)/SSE(FM)/p (4-16) 

has the F statis-^ical distribution with p and (n-p-1) de- 
grees of freedom. If the observed F value is large, in com- 
parison to the tabulated value of F with p and (n-p-1) de- 
grees of freedom at the 100a percent level, the result is 
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significant at level or ; that is, the null hypothesis is re- 
jected. 

To rank the SPIFR flying qualities criteria among the 
candidate criteria, a stepwise procedure is employed. It 
has the feature that the variables are introduced or deleted 
from the equation one at a time, and it involves examining 
only a subset of all possible equations. One of the catego- 
ries into which the stepwise procedure can be classified is 
the forward selection (FS) method. It starts out assuming 
that the model constitutes only of the intercept term. The 
first variable included in the equation is the one which has 
the highest simple correlation with the dependent variable 
y. If the regression coefficient of this variable is sig- 
nificantly different from zero, it is retained in the equa- 
tion, and a search for a second variable is made. The vari- 
able that enters the equation as the second variable is the 
one which has the highest correlation with y, after y has 
been adjusted for the effect of the first variable. The 
significance of the regression coefficient of the second 
variable is then tested. If the regression coefficient is 
significant, a search for a third variable is made in the 
same way. The procedure is terminated when the last vari- 
able entering the equation has an insignificant regression 
coefficient or all the variables are included in the equa- 
tion. An improvement to the FS algorithm which considers 
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the possibility of deleting a variable at each stage can be 
employed: a variable that entered in the earlier stages of 
selection may be eliminated at later stages. This improve- 
ment is referred to (Ref. 60) as backward elimination (BE). 

Efficient FORTRAN coding of the stepwise multiple regres- 
sion algorithm is available in Ref. 53. It provides the ca- 
pability of separately defining the significance levels a 
for entering and deleting variables. For the SPIFR analysis 
a= 0.05 was chosen for both tests . 


4.2 THE FLIGHT-^TEST-^BASED PERFORMANCE INDICATORS 

"Performance indicators" are the various metrics that may 
reflect the effects of SPIFR configuration changes. Using 
the nomenclature of Section 4.1, they constitute the possi- 
bilities for the vector of dependent variables for the re- 
gression analysis, The performance indicators may be 
classified into two distinct categories: (1) the subjective 
Pilot Opinion Ratings (PORs), and (2) the objective system 
evaluations . 

As the human operator is an integral part of the control 
and guidance loop, the subjective PORs constitute important 
experimental results. The pilot flying a realistic SPIFR 
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mission may pass direct judgement with regard to the effect 
of a given configuration change. One scale that relates pi- 
lot's opinions about the ease or difficulty with which air- 
planes can be controlled in a given flight situation to a 
numerical rating, is the Cooper-Harper Rating (CHR) 10-point 
scale (Ref. 61). It has been widely accepted as an aircraft 
performance metric. Several investigators advocate a sepa- 
rate metric for the assessment of pilot workload . The Simp- 
son-Sheridan 10-point workload Rating (SSR) is an example of 
this approach (Ref. 62). Other researchers (as in Ref. 63) 
think that the CHR scale reflects workload as well as per- 
formance levels. To study this problem with regard to the 
SPIFR flight regime, both the CHR and the SSR scales were 
used in this program to provide experimental data for com- 
parison. As up to three tasks could were flown consecutive- 
ly, knee-pad versions of both scales and of the grading 
sheet were prepared for in-flight pilot debriefing (Fig. 
4.2). As obvious from Fig. 4.2c, the pilot was required to 
evaluate the airplane performance and workload levels along 
entire SPIFR missions as well as along several segments 
characteristic to this flight regime. 
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a) Performance CHR Scale 


Figure 4.2: Knee-pad Versions of the Performance and 

Workload PORs and of the Evaluation Sheet 
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IMPOSSIBLE 


Impossible to perform all opera- 
tional TASKS PROPERLY 


Phot P^risi^ 


RATING 


1 

2 

3 


Is IT 

ACCEPTABLE? 


Very high levels of workload 

7 

Nol unacceptable 1 

INDICATE THAT THE PROBABILITY OF 

8 


ERRORS OR OMISSIONS IS HIGH 

9 

7 



10 


b) Workload SSR Scale 


Figure 4.2: 


Knee-pad Versions of the Performance and 
Viorkload PORs and of the Evaluation Sheet (cont'd) 
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EVALUATION SHEET 


MISSION VARIANT # 
CONFIGURATION # 

PILOT 

DATE 

SPEED RETRIMMING 

CHR 

SSR 

COMMENTS 

HOLDING PATTERN 

CHR 

SSR 

COMMENTS 

GLIDE SLOPE TRACKING 

CHR 

SSR 

COMMENTS 

OVERALL MISSION 

CHR 

SSR 

COMMENTS 


c) Evaluation Sheet. 


Figure 4.2: Knee-pad Versions of the Performance and 

Vt'orkload PORs and of the Evaluation Sheet (cont'd) 


3 



To complete this discussion with regard to the subjective 
performance indicators, there are researchers who not only 
advocate a separate workload metric, but who attempt to dis- 
tinguish between audio-visual, mental and motoric components 
of workload (Ref. 64, 65, 66 and 67). Such a differentiat- 
ing approach may be advantageous when the objective is, for 
example, optimal arrangement of cockpit displays. This au- 
thor, along with others (as in Ref. 68), prefers the as- 
sessment of the overall workload effect, which is most suit- 
ed to evaluation of a self-contained flight regime. 

The flight testing was carried out by the Princeton Uni- 
versity Chief Test Pilot only. In the research reported in 
Ref. 69 it was found that pilots differ by constant shifts, 
rendering similar gradients and trends of variation. At the 
time the SPIFR experiments were conducted, the Princeton 
Flight Reasearch Laboratory Pilot had accvimulated over 600 
logged IFR hours and total time of about 5000 hours. He 
flew each of the fifteen configurations twice. As pointed 
out in Ref. 68, master pilots exhibit excellent repeatibili- 
ty in their performance, which was confirmed by the results 
of this program. 

Each component of the column vectors of the performance 
indicators presented in this section, is a result of averag- 
ing individual indicator values, which were obtained for 
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several segments of several SPIFR tasks flown with a given 
configuration. The subjective Pilot Opinion Ratings (PORs) 
constitute the major part of the data in Table 4.1.^ The two 
last columns of the table represent an attempt to quantify 
the pilot's workload under SPIFR conditions objectively. As 
detailed in Appendix h, the evaluation pilot was asked to 
extinguish lights turned on (pseudo-randomly ) by the micro- 
processor program. The prerogative for his reaction was 
that it should take place only if his primary task of flying 
the SPIFR mission is not affected; pilot's priorities being: 
(l)control, (2 )navigation, ( 3 )communications , and (4) else. 
Normalizing (per 1000 sec) the number of pilot's reactions 
to the workload lights, a candidate performance indicator, 
which may reflect the workload level as a function of air- 
craft configuration variations under SPIFR conditions were 
obtained. The last column in the table consists of similar- 
ly-normalized numbers of discrete throttle-plus-elevator 
trim adjustments (extracted from time-histories plots such 
as in Fig .4.3). 

Figure 4.3 contains also the continuous time-history of 
the longitudinal stick deflections ^e. The RMS values of 
the yoke activity throughout a complete mission or along a 
particular flight segment may constitute performance indica- 


^ Compilation of the detailed POR data, based on which these 
values were computed, and the pilot commentaries, is pre- 
sented in Appendix E. 
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TABLE 4.1 


PORs , Reactions-to-Workload-Lights and Adjustments of 
Throttle-Plus-Elevator Trim as Candidate Performance 

Indicators 


CONFIG- 

URATION 

COMPLETE 

TASK 

HOLDING 

PATTERN 

GLIDE 

SLOPE 

AIRSPEED 

RETRIMMING 

REACTIONS 

TO 

WORKLOAD 

LIGHTS 

ADJUSTMENTS 
OF THROTTLE 
PLUS ELEVA- 
TOR TRIM 

CHR 

SSR 

CHR 

SSR 

CHR 

SSR 

CHR 

SSR 

1 

3.0 

3.25 

3.0 

3.25 

3.0 

3.25 

3.25 

3.25 

28.2 

49.5 

2 

3.0 

3.25 

3.0 

3.25 

3.0 

3.0 

3.0 

3.0 

25.0 

48.4 

3 

3.75 

3.75 

3.5 

3.5 

3.75 

3.5 

4.0 

4.0 

26.9 

54.9 

4 

3.25 

3.25 

3.0 

3.0 

3.25 

3.25 

3.25 

3.25 

28.6 

45.5 

5 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.5 

3.5 

25.0 

46.0 

6 

3.0 

3.0 

3.25 

3.25 

2.75 

3.0 

3.25 

3.0 

28.3 

45.7 

7 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.25 

3.25 

28.5 

42.8 

9 

3.25 

3.25 

3.0 

3.0 

3.0 

3.0 

3.25 

3.5 

28.9 

41.5 

10 

3.5 

4.25 

3.0 

3.0 

3.25 

4.5 

4.5 

4.5 

29.2 

57.4 

11 

3.0 

3.5 

3.0 

3.0 

3.0 

3.5 

3.25 

3.5 

28.4 

56.8 

12 

3.25 

3.5 

3.0 

3.0 

3.0 

3.25 

4.25 

4.5 

29.2 

41.3 

13 

3.25 

3.5 

3.0 

3.0 

2.75 

3.5 

4.0 

4.5 

28.0 

48.5 

14 

3.0 

3.5 

3.0 

3.25 

3.0 

3.0 

3.5 

4.0 

28.6 

51.6 

15 

4.0 

4.5 

3.5 

3.75 

3.75 

4.5 

4.5 

4.5 

27.7 

52.2 

16 

3.0 

3.0 

3.0 

3.5 

2.75 

3.0 

2.75 

2.5 

28.8 

39.0 
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Figure 4.3; Time Histories of the Longitudinal Stick, the 
Throttle and the Longitudinal Trim Wheel 
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tors. Note that cockpit controls manipulations (and 
tracking performances as elaborated later in this section) , 
and not actual aerodynamic surfaces deflections were exam- 
ined . The latter were a superposition of :the pilot’s attempt to 
control the given configuration and of the implicit model 
following implementation commands, which simulated the par- 
ticular configuration in flight. The RMS values of ^e(t) 
are. 


RMSjg = [(25e?)/(n-l)]^/2 {A- 11 ) 

They are summarized in Table 4.2. In this section n is the 
number of points in the examined time series. 

The determination of the start and the end points for 
the computation of the objective performance indicators re- 
quired accurate identification of the different flight seg- 
ments. This was done by concurrent examination of optimally 
smoothed flight path variables and controls plus VOR and 
glide slope tracking time histories, which were extracted 
from the data file magnetic tapes. Figures 3.9 to 3.12 and 
4.3 to 4.5 constitute samples of this type of representa- 
tion. In all figures, the symbols are 50 sec apart. As ob- 
vious from Fig. 4.4, the actual ILS or MLS^ tracking starts 


2 

The acronyms ILS and MLS stand for Instrument Landing Sys- 
tem and Microwave Landing System, respectively. The MLS 
makes use of more advanced technology. For both systems 
the vertical needle tracking is referred to as 'localizer 
tracking', and horizontal needle tracking is referred to 
as 'glide slope tracking’. 
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TABLE 4.2 


Longitudinal Stick Deflections RMS Values as Candidate 

Performance Indicators 


CONFIG- 

URATION 

COMPLETE 

MISSION 

[DEG] 

CONSTANT 

ALTITUDE 

[DEG] 

CONSTANT 

AIRSPEED 

[DEG] 

CLIMB 

[DEG] 

DESCENT 

[DEG] 

■ 1 

0.5 

0.4 

0.4 

0.5 

0.5 

2 

0.5 

0.4 

0.3 

0.6 

0.6 

3 

0.5 

0.5 

0.3 

0.4 

0.5 

4 

0.4 

0.3 

0.3 

0.4 

0.4 

5 

0.5 

0.4 

0.4 

0.5 

0.5 

6 

0.4 

0.4 

0.3 

0.4 

0.4 

7 

0.4 

0.3 

0.3 

0.5 

0.4 

9 

0.4 

0.3 

0.3 

0.4 

0.4 

10 

0.3 

0.3 

0.3 

0.4 

0.4 

11 

0.3 

0.3 

0.2 

0.3 

0.3 

12 

0.3 

0.3 

0.3 

0.4 

0.4 

13 

0.4 

0.4 

0.4 

0.4 

0.4 

14 

0.4 

0.4 

0.2 

0.4 

0.3 

15 

0.9 

0.5 

0.4 

0.6 

1.0 

16 

0.3 

0.3 

0.3 

0.4 

0.3 
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at about t=1400 sec. Figure 4.5 demonstrates the two VOR 
course deviation time histories; either or both may reach 
full scale deflection as the pilot selects cross-bearing ra- 
dials, enters holding patterns, or crosses a VOR station. 
As for MLS tracking, correlation of the various time histo- 
ries and the horizontal trajectory projections renders the 
intervals in which the pilot was supposed to track one of 
the two VOR radials. 

The tracking performance was quantified using two different 
methodE^One is the computation of the percentage of out-of-band 
dwelling time with respect to the complete MLS or VOR track- 
ing time on a given segment. The permissible bands were 
set, in accordance with the pilot's strategy, to plus/minus 
one coarse division on the tracking instrument. This 
amounts to +2 deg for VOR, +0.5 deg for the localizer, and 
+0.2 deg on the glide slope. In Fig. 4.4 the band is shown 
for the localizer ("+" symbols for 50 sec intervals). Note 
that it is shown with regard to the electrical zero refer- 
ence, which has a -0.25 deg bias, as may be observed from 
from the instrument idling throughout the other segments of 
flight. The +2 deg band for VOR tracking was superimposed 
on the plot of Fig. 4.5. The numerical values of the out- 
of-band percentages are summarized in Table 4.3. 

The other method for quantifying the tracking performance 
was to compute the RMS values for deviation errors. For lo- 
calizer tracking. 
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Figure 4.4: Localizer and Glide Slope Deviations 
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Figure 4.5; VOR Deviations 
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for glide-slope tracking, 

RMSgg = C(2e2^)/(n-l)]^/2 

and for VOR-radial tracking. 


RMS^OR = n2*2^j^)/(n-l)]^/2 (4-20) 

Obviously, the length of a segment, n, varies from segment 
to segment. All these evaluations of tracking performance 
are summarized in Table 4.3. It is important to realize 
that although they are not in the vertical plane, in which 
the configurations are alternated, the localizer and VOR 
"wandering" errors may reflect changes in the pilot's work- 
load due to changes in the aerodynamic coefficients. Note 
that the RMS values and not the standard deviations of these 
"wandering" errors were computed to capture the integral ef- 
fect of the SPIFR flight regime. Also, SPIFR tasks involve 
injection of events and discrete pareimeter variations (such 
as or 5^^ i.e., nonstationary conditions. Thus, the 
RMS values for tracking or holding errors may be the most 
appropriate performance indicators . 
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TABLE 4.3 


MLS and VOR Tracking RMS Values and Out-of-Band Time 
Percentages as candidate Performance Indicators 


CONFIG- 

URATION 

«^\oc 

[DEG] 

^^GS 

[DEG] 

[DEG] 

T 

LOC 

[%] 

T 

GS 

[%] 

T 

VOR I 

[%] i 

1 

0.2 

0.3 

2.2 

5 

43 

36 i 

2 

0.3 

0.2 

3.0 

7 

29 

51 

3 

0.2 

0.3 

2.0 

5 

30 

20 

4 

0.4 

0.4 

2.8 

8 

66 

48 

5 

0.2 

0.3 

2.0 

5 

30 

30 

6 

0.2 

0.2 

2.4 

4 

31 

27 

7 

0.3 

0.4 

2.8 

3 

5'0 

33 

9 

0.4 

0.3 

2.0 

14 

37 

30 

10 

0.3 

0.3 

2.1 

4 

41 

29 

11 

0.2 

0.1 

2.1 

1 

2 

31 

12 

0.5 

0.3 

2.1 

30 

32 

35 

13 

0.3 

0.2 

2.1 

16 

43 

30 

14 

0.3 

0.1 

2.1 

6 

15 

38 

15 

0.8 

0.3 

2.5 

45 

53 

40 

16 

0,2 

0.2 

2.6 

1 

32 

40 

_ 
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Based on information of the type contained in Fig. 3.12, 
additional performance indicators may be constructed. The 
evaluation pilot was instructed to fly controlled SPIFR mis- 
sions, in which he had to track certain flight path vari- 
ables, maintaining them at prescribed values. The values 
chosen represent typical practices for GA aircraft in a ter- 
minal air traffic control environment were: 

* airspeed of 75 KIAS along holding patterns, climb and 
descents; and of 105 KIAS along straight and level seg- 
ments . 

* altitudes of 1500 ft, 2000 ft or 3000 ft (depending on 
the particular segment of a specific flight track) for 
altitude holding tasks . 

* rates of climb and descent of 500 ft/min. 

Instructing the pilot to track these values in appropriate 
flight segments was a secondary but realistic tracking work- 
load, with prospects to bring out the effects of the aerody- 
namic configurations under SPIFR conditions. Note that Fig. 
3.12 shows the indicated airspeed, which is the one usually 
tracked in the terminal area. 

First, as for evaluation of the VOR and glide slope per- 
formance, the appropriate flight segments were identified; 
then the RMS values of deviations from holding altitude, 
airspeed and rate of climb or descent were computed. The 
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out-of-band time approach was not pursued with regard to 
these variables because preliminary examination of the ex- 
perimental results indicated that it may provide no decisive 
differentiation between the configurations flown. 

Having identified the constant altitude segments, the 


following quantities were computed: 

h = (2h^)/n (4-21) 

Ah = h - h„^„„ ; (h^^^ =1500 ,2000 or 3000 ft) (4-22) 

comm comm 

MS^ = (2h?)/(n-l) (4-23) 

RM^h = C2(h^ - h)^/(n -l)]^/^ (4-24) 

For constant airspeed segments. 


V = (2V^)/n (4-25) 

AV = ; (V^^„ =75 or 105 KIAS ) (4-26) 

comm comm 

MS^ = (2V?)/(n-l) (4-27) 

RMS^^ = [2(V^ - V)^/(n - 1)]^/^ (4-28) 

For climb and descent segments, in addition to equations 
(4-25) to (4-28) with V^omm“^^ KIAS, the h^|^(t) time histo- 
ries were computed and; 

h = (2h^)/n (4-29) 
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(4-30) 


RMS^ = [(2(hi - h)^)/(n-l)]^/2 

The FORTRAN codes which took the information from the opti- 
mally-processed data file tapes and performed these computa- 
tions, are given in Ref. 17. The results of their applica- 
tion are summarized in Tables 4.4 and 4.5. 

In the next section, the multiple regression algorithm is 
applied to the performance indicators prepared in this sec- 
tion versus the candidate SPIFR flying qualities criteria of 
Chapter 2. Before doing so, a closer examination of Tables 
4.1 to 4.5 is called for. It may be noted that performance 
evaluations along holding pattern segments provide no dis- 
tinct differentiation between the aerodynamic configurations 
flown, and they were not processed any further. A closer 
look at Table 4.2 reveals that all the numerical values of 
the stick deflection RNSs are lower than 1 deg, out of a 
stick range of over 30 degl This means that the yoke prac- 
tically did not move from its zero position. It turned out, 
following pilot debriefing and reexamination of time histo- 
ries of the type shown in Fig. 4.3, that an experienced pi- 
lot may work directly the longitudinal trim wheel, instead 
of first using the stick and then neutralizing the stick 
force. Thus, there was no sense in further processing of 
the data of Table 4.2. As a result of these observations, 
the number of performance indicators considered for the re- 
gression analysis was reduced to 22. 
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TABLE 4.4 


Altitude and Altitude Gradient Tracking RMS Values as 
Candidate Performance Indicators 
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TABLE 4.5 


Indicated AirSpeed Tracking RMS Values as Candidate 
Performance Indicators 


CONFIGUR- 

ATION 

CONSTANT 

AIRSPEED 

SEGMENTS 

RMSv[FPS] 

CLIMB 

DESCENT RMS^[FPS] 

RMS^[FPS] 

ON GLIDE 
SLOPE 

EXCEPT FOR 
GLIDE SLOPE 

OVERALL 

1 

2.5 

■ 2.5 

3.0 

7.2 

5.1 

2 

2.5 

1,5 

4.0 

8.0 

6.3 

3 

3.0 

3.5 

3.1 

3.0 

3.0 

4 

3.0 

4.5 

4.0 

3.0 

3.5 

5 

2.5 

3.0 

3.1 

3,2 

3.1 

6 

2.0 

2.5 

4.0 

4.5 

4.3 

7 

3.1 

3.3 

3.0 

4.5 

4,0 

9 

4.0 

3.5 

3.5 

3.5 

3.5 

10 

3.0 

3.0 

3.0 

6.0 

4.5 

11 

3.0 

3.5 

4.0 

8.1 

6.3 

12 

2.0 

2.5 

3.0 

2.0 

2.5 

13 

3.5 

4.0 

3.0 

4.5 

4.0 

14 

3.0 

3.1 

3.0 

2.5 

2.7 

i 

15 

3.5 

5.0 

6.0 

3.0 

i 

4.2 

16 

3.0 

2.5 

3.2 

4.5 

4,0 

■ 

' 
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4.3 DERIVATION OF SPIFR FLYING QUALITIES CRITERIA 


This section reports on the application of multiple re- 
gression to the candidate theoretical criteria (vectors in 
Table 2.2) against each of the experimental performance in- 
dicators (Section 4.2). First, as pointed out in Section 
4.1, a decision had to be made in each case whether a trans- 
formation of variables is required for any of the candidate 
criteria. Scatter plotting of the performance indicators 
versus each of the candidate criteria proved to be an 

efficient means for making such decisions. Examples of this 
approach are given in Fig. 4.6 and 4.7. Figure 4.6 shows 
the distinct trend in the localizer tracking RMS error, 

RMSj^^^, as a function of pitch attitude sensitivity to 

★ 

changes in airspeed, A0 ^^'^comm' Other candidate criteria 
did not exhibit any decisive effect on this performance in- 
dicator. Similarly, Fig. 4.7 suggests a relationship be- 
tween the rate-of-descent holding RMS error, RMS^, and the 
phugoid total damping, observed from all 

scatter plots of this kind that there was no need for trans- 
formation of variables for the application of the regression 
algorithm. 

The result of the multiple regression with regard to the 
RMS^^^ performance indicator is. 
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RMSioc = -0. 19-1. 0(Aa* [deg] [kt] ) (4-31) 

with an «= 0.05 statistical significance level and zero 

values for all other regression coefficients. The correla- 

2 

tion coefficient R equals 0.74, i.e. 74, percent of the ex- 
perimental results are explained by the relationship in eg. 
(4-31). With regard to hypothesis testing, ^Qj^ggj-ved “ 36.8 
and as the statistical degrees of freedom are n = 15 and 
p = 10, ^tabulated 2.9 (Ref. 59) at the 100a = 5 

percent level. F^^served "" ^tabulated' result is 

significant at the level «= 0.05, and the null hypothesis 
is, indeed, rejected. The same criterion is also singled 
out by several other independent performance indicators, 
such as T^q^ and RMS^^^. 

To derive the numerical value for the Afl*/AV flying 

qualities criterion, recall from the previous section that 
the pilot tries to keep the localizer needle within 0.5 deg 
of the center. Substitution of this value into eg. (4-31) 
yields, 

A0*/AV^^„^ ^ -0.7 deg/kt (4-32) 

Similar considerations applied to the regressed relation- 
ships, T, (A^*/AV ) and RMS., (Afl*/AV ), crosscheck 

^ loc ' comm Vgs ' comm'' 

this result. A design which features an L ^ aerodynamic de- 
rivative that is too low, may be problematic in complying 
with this criterion. 
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Regression for the CHR , ^ , SSR , , , CHR , and SSR 

^ whole whole gs' gs 

performance indicators identified another SPIFR flying 
qualities criterion, which also may be related to variations 
in Lq. This criterion is the stick force sensitivity to 

1r 

changes in airspeed, Af /AV . For example, for 

s' comm ^ 


CHR 


whole 


= 2.5 + 1.4(Af^Clb]/AV^^^[kt]) 


(4-33) 


Although CHR =6.5 is still considered flyable, note that 
the philosophy of this research was to isolate the airframe 
dynamic response from other factors, such as turbulence. 
Thus the criterion ought to be computed for a lower bound of 
this performance indicator (this reasoning also was applied 
in Ref. 10). Substitution of CHR = 4.5 into eq. (4-33) 
yields. 


Af*/AV 


comm max 


=1.4 Ib/kt 


(4-34) 


As mentioned at the beginning of this section (Fig. 4.7), 
the phugoid total damping criterion, (fw^)p was deduced from 
the RMS error in rate-of descent holding, RMS.ji^, 

RMS^ = 1.96 - 17.81(rw^)p (4-35) 

The permissible minimum value of (fw^)p, allowing RMS^ up to 
100 fpm, should be. 


(r 


0 > ) 
n'min 


= 0.02 


(4-36) 
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Typically for light aircraft, “ np about 0.34 rad/sec 
(Table B.l). Thus, the phugoid damping ratio itself may be 
required to stay in the range. 


r_^0.06 (4-37) 

S' 

A configuration with TD^ aerodynamic coefficient, that is 

too low, may be problematic in this respect. Note that the 

actual experimental result is reflected in eg. (4-36), and 

f was computed for comparison with Ref. 9. The latter re- 
P 

quires, 

r > 0.04 for normal operations (Level 1) 

P 

r > 0 for Level 2 (definition of Level 3 (4-38) 

ir 

excludes SPIFR operations) 

Comparing eq. (4-38) and (4-37), it is suggested that at 
least the numerical value for Level 1 in eq. (4-38) be 
adopted for the FAR 23 (Ref. 5). 

Relating SPIFR experimentally-derived flying qualities 
criteria to existing military or civil specifications, as 
exercised above for may provide an important per spec- 

tive. For example, variation in h, which brought out the 
phugoid damping ratio as a SPIFR criterion, may also affect 
the pilot's performance in an additional way. Flying the 
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Figure 4.7; Rate-of-Descent Holding RMS Error Versus the 
Phugoid Total damping. 
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landing approach, the pilot should be able to maintain air- 
speed using only the elevator; throttle adjustments in this 
critical flight phase may increase his workload to an unsafe 
level. To prevent this. Ref. 9 sets detailed requirements 
for flight path stability, which "is defined in terms of 
flight path angle change where the airspeed is changed by 
the use of pitch control only". As the flight path angle 
sensitivity to change in airspeed, Ay/AV is. 


AY/AV = (l/V)Ah/Av (4-39) 

it is obvious that h may affect the pilot's performance 
also through its airspeed change gradient. 

As shown in Ref. 70, flight path stability variations 
correspond to the power required curve for a given configu- 
ration. In terms of aerodynamic coefficients, 

AY/AV = -d/g)[D^ - D„ (L^/V)/(Ltt/V)] = 

(l/g)CX^+ (g-X^V)(-Z^/V)(-Z^)J (4-40) 

Substitution of the numerical values from Chapter 2 yields 
Ay/AV for all SPIFR configurations. The results of this 

3 

computation are summarized in Table 4.6. 


3 

Configurations 15 and 16 did not affect flight path sta- 
bility, because the ratio Da/^a was constant for their 
in-flight simulation. 
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TABLE 4.6 


Computation of Flight Path Stability Parameter for SPIFR 

Configurations 


CONFIGURATION 

Ay/AV 

[DEG/KT] 

1 to 10,15,16 

-0.045 

11 

-0.105 

. 12 

+0.015 

13 

+0.204 

14 

-0.294 


The flight path stability requirement in Ref. 9 is: "the 
curve of flight path angle versus true airspeed (Fig. 4.8) 
shall have a local slope which is negative or less positive 
than ; 


a. Level 

1 — 

0.06 deg/kt 

b. Level 

2 

0.15 deg/kt 

c . Level 

3 

0.24 deg/kt 
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Comparing the values in Table 4.6 to these requirements, it 
may be anticipated that only configuration No. 13 (X^ = 0) 
would be of serious concern. Although this is insufficient 
for statistical analysis, it should be kept in mind that the 
pilot may be sensitive to Ay/AV as well as to f . 


y [DEG] 



Figure 4,8: Flight Path Angle Versus Airspeed on Descent 


Additional insight may be gained by evaluating the pitch 
attitude sensitivity criterion (eq. (4-32)) in view of Fig. 
4.8. As obvious from Table B.2, the throttle adjustments. 
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which are required for steady-state airspeed retrimming, are 

relatively small. Thus/ although the two problems are not 

* 

identical, the Afl /AV . criterion suggests that a too 
strong negative slope in Fig. 4.8 (the right side of the 
curve) may also be disturbing to the pilot of a fast-de- 
scending airplane. 

With regard to the stick force sensitivity. Ref. 5 ad- 
dresses this issue qualitatively; "The stick force must vary 
with speed so that any substantial speed change results in a 
stick force clearly perceptible to the pilot" . Any possible 

quantification of this stick force sensitivity criterion, 
* 

Afg/AV^Qj^, is important because it is equivalent to a per- 
ception by the pilot of having direct control of velocity. 
This perception simplifies the piloting task by reducing the 
number of integrations required for proper control . Such a 
quantitative upper bound is indicated by the results of this 
research (eq.(4-34)). This correlation between the derived 
SPIFR criteria and the requirements in the civil and mili- 
tary specifications enhance the findings of this research. 
Thus, the flying qualities criteria in eq. (4-32), (4-34) 

and (4-38) constitute guidelines, which the GA aircraft de- 
signer should consider. 

Referring back to the fifteen aerodynamic configurations 
which were examined in this research, only L „ and X,, were 
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found to feature ranges of values, which may be very signif- 
icant under SPIFR conditions (their physical significance 
was discussed in Section 2.2). All other derivatives did 
not stand out above the high background navigation/communi- 
cation workload. Also, note that each of the performance 
indicators, which did confirm candidate criteria as actual 
SPIFR flying qualities criteria, rendered a single dominant 
criterion (with an at = 0.05 statistical significance level). 
All other performance indicators failed to exhibit trends as 
a function of the aerodynamic configurations . This includes 
both the physically obvious metrics, such as RMS values of 
airspeed and altitude holding errors, and the artificially- 
deviced indicators, such as the normalized frequency of re- 
action to workload lights. 


An important by-product of the above analysis is the com- 
parative evaluation of the CHR and the SSR pilot opinion 
rating scales. In representations of the type of Fig. 4.6 
the SSR workload ratings are practically the same as the 
CHR, and provide the same trends of variation. In few cases 
they differ by up to 0.5 rating. As this is less than the 


generally accepted which is 1.0 rating. 


the use of SSR 


along with CHR in SPIFR experiments appears to be redundant. 


Although this observation relies on ratings by a single pi- 
lot, this author believes that it holds in the range 2.0 to 
5.0, which was obtained in the SPIFR flight tests. Also, as 
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shown in the above analysis, objective performance metrics 
are important complements to subjective PORs . 

The FORTRAN and JCL codes for computation of the perform- 
ance indicators, the scatter print plotting and the statis- 
tical analysis are given in Ref. 17. 
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Chapter 5 

SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


5.1 SUMMARY OF THE RESEARCH METHODOLOGY 

This research addressed the issue of degradation in GA 
safety which occurs under SPIER conditions. The "man-ma- 
chine" performance in this flight regime is a function of 
several factors including aircraft dynamic response and in- 
creased navigation/ communication workload. As a first step 
toward alleviating the SPIER safety problem, the relative 
importance of these two major factors was determined. To 
achieve this objective a self-contained methodology that in- 
volves theoretical and experimental aspects was developed . 
The airframe response in the low-frequency range was varied 
in flight testing, and pilot's performance and workload me- 
trics were obtained as a function of these variations. 

The experiment-based performance indicators included both 
pilot judgment and objective ability to carry out typical 
SPIER tasks such as MLS and VOR radial tracking and altitude 
and airspeed holding. The range of variation for each of 
the aerodynamic coefficients was chosen to cover both the 
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existing light aircraft fleet and recent trends in GA de- 
sign. For each of the chosen configurations, frequency- and 
time-domain-related candidate flying qualities criteria were 
obtained from theoretical considerations. Finally, the mul- 
tivariate regression algorithm was applied to this data 
base, which consisted of a set of vectors of the candidate 
flying qualities criteria (horizontal axes for the regres- 
sion) and of the performance indicators' vectors (vertical 
axis for the regression analysis). 

For accurate computation of the performance indicators, 
an efficient optimal flight path reconstruction algorithm 
was developed. Its mathematical modeling accounted for 
Earth rotation and geometry. Using as inputs aerodynamic 
and inertial measurements and outputs of a microprocessor- 
based multiple DME scanner, it provided results in the True 
North-East navigational coordinates . As the model was non- 
linear, the extended Kalman filter algorithm was used. To 
achieve better filter performance in terms of accuracy and 
robustness, the mathematical model was partitioned into low- 
er-order submodels, which were processed sequentially. Ac- 
curate tuning was obtained by maintaining a proper balance 
between state covariances and the covariances of the meas- 
urement residuals. The Rauch-Tung-Striebel optimal smoother 
algorithm and Fraser's smoothability condition were employed 
to enhance accuracy and efficiency in trajectory estimation. 
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The accuracy rendered by this optimal flight path recon- 
struction scheme was demonstrated on actual flight test 
data. It was shown to provide an assessment of the flight 
technical error of the VOR/VOR navigational mode, as well as 
the SPIFR performance indicators. 


5.2 CONCLUSIONS AND RECOMMENDATIONS 


The following important results were derived: 

* A phugoid mode that is too lightly damped, produces un- 
satisfactory flying qualities, and it may have an ad- 
verse effect on safety in the SPIFR flight regime. It 
is suggested that the phugoid damping ratio should not 
be lower than 0.04, which is consistent with the cri- 
terion of the military flying qualities specifications. 

* The current FAA reference to stick force sensitivity, 

* 

is qualitative. Any quantification of this 
criterion is important, because it is equivalent to a 
perception by the pilot of having direct control of ve- 
locity, which simplifies the piloting task. Such a 
quantitative upper bound is indicated by the results of 

this research: Af*/AV ^ 1.4 Ib/kt. 

s' comm ' 

* The pitch attitude sensitivity to airspeed change from 

one trimmed flight condition to another, A9 is 

^ comm 

suggested as a new criterion, for the SPIFR flying 
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qualities. Its value should not be lower than 
-0.7 deg/kt. 

Experiment-based objective performance metrics, such as 
tracking error RMS values, were found to agree with a single 
subject's opinion in SPIER task evaluation. Also, the cur- 
rent research suggests that the Cooper-Harper pilot opinion 
scale is a good indicator of perceived pilot workload. Its 
results indicate that the SPIER navigation/communication 
workload is important, compared to workload due to low-fre- 
quency aircraft dynamics. 

Recommendations ; 

* To improve the safety of General Aviation single-pilot 
lER operations, it is suggested that flying qualities 
criteria for the SPIER flight regime, which were de- 
rived in the course of this research, be considered for 
incorporation into the Eederal Aviation Regulations 
(EAR) 23. 

* The flight path reconstruction methodology, developed 
here, can provide flight technical error evaluation of 
other navigational systems, such as LORAN-C. It may be 
used in such projects as the NASA Langley TCV, ^ and to 
investigate, statistically, flight path deviations by 


^ Terminal Configured Vehicle project, 
737 as a flight-test bed. 


which uses the Boeing 
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recording DME ranges along witli inertial data» 
altitude, and airspeed. 

* This systematic approach, which combines theory and 
flight testing, should be employed to identify lateral- 
directional flying qualities criteria for SPIFR opera- 
tions . 
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Appendix A 

AIRCRAFT AND DATA ACQUISITION SYSTEM PREPARATION 


This Appendix describes the preparation of the in-flight 
simulator and of the onboard digital data acquisition system 
for SPIFR flight testing. Extensive engineering and techni- 
cal effort was required for aircraft modifications and re- 
wiring, for new avionics system installation, and for on- 
board experimental setup integration. The results of this 
effort are summarized in the following sections . 


A.l AIRCRAFT SYSTEM MODIFICATIONS 

The Avionics Research Aircraft (ARA) is a Ryan Navion 
(N5113K) that has been modified into a fly-by-wire (FEW), 
variable-stability aircraft (Fig. A.l). It is capable of 
simulating a variety of other aircraft using feedback con- 
trol and command augmentation. The ARA is equipped to meas- 
ure attitude, angular rates, and linear accelerations in 
three axes, aerodynamic angles (a, 0 ), airspeed, altitude, 
and a nvimber of other flight variables. Details of the ARA 
FEW system can be found in Ref . 71 . 
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The evaluation pilot was to fly a. SPIFR mission with the 
ARA responding as a desired configuration. In an emergency, 
the safety pilot could override the FEW system and take di- 
rect control of the aircraft (Fig. A. 2). 

To be used with the SPIFR program, the ARA had to undergo 
extensive modifications. These included: 

* Design and installation of a modular instrument panel. 

* Acquisition and installation of a modern navigation/ 
communication instrument package. 

* Addition of secondary workload devices in the cockpit. 

Figure A. 3 illustrates the ARA's modular display panel 
configuration, with the evaluation pilot's station on the 
left, the safety pilot's station on the right, and the Ben- 
dix BX-2000 navigation/communication stack separating the 
two. The Distance Measuring Equipment (DME) readout is 
mounted on a switching panel at the top of the radio stack. 
The Very-high-frequency-Omni-Range (VOR) navigation/communi- 
cation unit is located under the switching panel . The blank 
space below this unit is reserved for an Automatic Direction 
Finder (ADF) and a transponder. 

The DME unit has been integrated into the experimental 
electronics, maintaining the capability to sequence the 
available navigational stations automatically (through 
microprocessor control) . The importance of this option is 
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Figure A. 2: Overview of the ARA In-Flight Simulator System 
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discussed in Section 2.5. The technical implementation de- 
tails may be found in Ref. 72. 

The safety pilot's panel is a permanent fixture, with 
conventional instruments and elements for control of the 
variable-stability system. The latter occupy the right side 
of the panel and the lower and middle consoles. The evalua- 
tion pilot's panel can be removed as a unit to facilitate 
installation of alternate panels for other investigations. 
Secondary workload meters, lights, and switches also have 
been added to the panel . 

The secondary workload meters are additional instruments 
slaved to the onboard microprocessor, which occasionally 
forces the needles into their "red zones". Alternately, the 
pilot can be asked to extinguish lights turned on {pseudo- 
randomly) by the microprocessor program. It is also possi- 
ble to simulate typical communication workload by blending 
audio inputs from a pre-recorded tape with various instruc- 
tions radioed from the ground on the flight test frequency. 
Simulated air traffic control vectoring is provided on the 
same channel, with instructions given by the safety pilot. 
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Figure A. 3: Cockpit Displays of the Avionics Research Aircraft. Modular SPIFR 

Evaluation Pilot Panel at Left. 
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A. 2 INSTRUMENTATION AND DATA RECORDING SYSTEM 


The SPIER digital data acquisition system is illustrated 

in Fig. A. 4. It is built around the SPIER microcomputer, 

which uses the Z-80A central processing unit and the Am9511 
• . TM 

mathematics processor in a Multibus architecture. As cur- 
rently configured, the SPIER microcomputer contains 48K 
bytes of RAM (Random Access Memory) and 16K bytes of PROM 
(Programmable Read-Only Memory). It accepts 32 analog in- 
puts and produces 6 analog outputs . 

The ARA's safety pilot communicates with the SPIER micro- 
computer through a hand-held Control/Display Unit (CDU), the 
Termiflex HT/4. The pilot is able to start and stop pro- 
cessing or recording through the CDU, change stored numeri- 
cal values, and so on. Conversly, the CDU can display in- 
ternally triggered error messages to the safety pilot. The 
evaluation pilot normally is unaware of the SPIER Microcom- 
puter's operation, other than through secondary workload 
stimuli and responses. 

Analog and digital inputs and outputs shown in Fig. A. 4 
are, for the most part, self-explanatory. Tables A.l and 
A. 2 contain lists of inputs and outputs. The SPIER Micro- 
computer obtains its analog inputs from the Digital Avionics 
Research System (DARE) Junction Box (J-Box) previously in- 
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CONTROL/DISPLAY 


SPIFR MICROCOMPUTER 


RECORDING UNIT 


• Termiflex HT/4 

• Executive Control 


ANALOG INPUTS 


• Air Data 

o Inertial Data 

• Navigation Data 

• Control/Trim 


DIGITAL INPUTS 


• Navigation Data 

• Mode Switches 

• Workload Response 



• MSC 8004 Single 
Board Computer 

• iSBC 116 Memory 

• iSBC 732 Analog 
Input/Output 

• Spare 

• FRL DME Distance & 
Frequency Converter 


• Spare 

• Spare 

• Spare 


NAVIGATION/COMMUNICA- 


TION (Bendix BX-2000 

• DM-2030 DME 

• CN-2011 Dual VOR/ 
Comm 


• Hewlett Packard 2644 
Cartridge Drive 

• "3M'' Tape Cartridge 


ANALOG 'OUTPUTS 


Workload Meters 


• Spare 


DIGITAL OUTPUTS 


« Workload Lights 


• Nav/Comm Frequencies 


Figure A. 4: SPIFR Digital Data Recording System. 


















TABLE A.l 


Input Assignments for SPIER Digital Data Recording System 


Analog Inputs 


1. 

Control Column Angle 

17. 

Yaw Trim 

- 2. 

Throttle Command 

18. 

Roll Trim 

3. 

Elap Command 

19. 

Elevator Deflection 

4. 

Pitch Trim 

20. 

Throttle Setting 

5. 

Pitch Angle 

21. 

Elap Deflection 

6. 

Pitch Rate 

22. 

Axial Acceleration 

7. 

Airspeed 

23. 

Aileron Deflection 

8. 

Normal Acceleration 

24. 

Rudder Deflection 

9. 

Control Wheel Angle 

25. 

VOR#l Azimuth 

10. 

Eoot Pedals 

26. 

Angle of Attack 

11. 

Yaw Angle 

27. 

Barometric Altitude 

12. 

Sideslip Angle 

28 . 

Spare 

13. 

Roll Angle 

29. 

MLS Azimuth 

14. 

Roll Rate 

30. 

MLS Elevation 

15. 

Yaw Rate 

31. 

VOR#2 Azimuth 

16. 

Lateral Acceleration 

32. 

Spare 


Digital Inputs 
1 . DME Distance 

5. 

Response to Workload Lights 

2 . VOR Erequency Code 

6 . 

Spare 

3 . DME Erequency 

7. 

Spare 

4 . Time 

8. 

Spare 


stalled in the ARA for another NASA program. Thus, there is 
a high degree of "plug compatibility" between the SPIER and 
the DARE programs. A prescimpling filter (16 cps break -point 
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TABLE A. 2 


Output Assignments for SPIFR Digital Data Recording System 


Analog Outputs 


1. 

Secondary workload 

meter 

#1 

4. 

Spare 

2. 

Secondary workload 

meter 

#2 

5. 

Spare 

3. 

Secondary workload meter 

#3 

6. 

Spare 


Digital Outputs 

1. DME tuning 

2. DME station indicator 

3. Pilot workload lights 


4. Avionics System status 
lights 

5 . Tape recorder 


frequency) has been introduced for each analog channel to 
filter out the engine-vibration- induced noise . 

Figure A. 4 also illustrates the digital radio tuning fea- 
ture that will be put to use during the next phase of the 
research. Error budget analyses, presented in Chapter 2, 
confirmed the superiority of DME over VOR for position fix- 
ing, even at the relatively-short ranges used in our flight 
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tests. Consequently, it is advantageous to substitute mul- 
tiple DME measurements for VOR measurements in flight data 
reduction. The BX-2000 DME unit can acquire and lock on a 
new station in less than one second; this feature has been 
used in DME-only "round-robin" position fixing for flight 
path determination . 

The digital tape recording unit was the Hewlett Packard 
(HP) 2644 terminal, which housed two DCIOOA magnetic tape 
cartridge drive units. Its built-in memory enables tran- 
sition from one cartridge to the other without losing any 
information. Such a pair of cartridges had a storage capa- 
bility of about 220K bytes, which was more than enough for a 
complete SPIER mission run. 

To accomodate the flight electronics, a pallet to fit 
into the ARA-aircraft behind the pilots ' seats has been de- 
signed and built by the ERL technical staff. It weighs 215 
lb and uses the same mounting brackets as the DARE pallet. 


A. 3 SOFTWARE DEVELOPMENT 


The SPIER program focused on the low-frequency dynamic 
response of the airframe and on navigation-related informa- 
tion, whose rate of change is low as well. As discussed in 
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Section 2.4, simulated SPIFR flight duration had to be about 
30 min, during which all the data channels had to be record- 
ed at least once every second. Thus, the main objectives of 
the onboard software design were to: 

* Sample the analog data at a high enough rate to avoid 
aliasing . 

* Compress the high-frequency data so that the most sig- 
nificant flight test information could be recorded ef- 
ficiently with minimal error . 

* Trigger preprogrammed sequences of the secondary work- 
load devices (lights, dummy meters). 

* Enable the safety pilot to operate the data acquisition 
system via the hand-held CDU. 

The information recorded in flight can be separated into 
"slow" and "fast" variables. The "slow" variables are prin- 
cipally the positional measurements, which can be sampled 
once per second with minimal aliasing effect. The "fast" 
variables, for example, angular rates and linear accelera- 
tions, are sampled ten times per second. For the sake of 
data compaction, they were averaged and recorded once each 
second. The simple averaging scheme is analogous to "low- 
pass" filtering. Thus, low-frequency information was passed 
with little modification, while high-frequency signals were 
attenuated . 
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The HP 2644 ' s recording format uses 16-bit binary words. 
The SBC 732 A/D board is designed to fill in the 12 left- 
most bit positions of a 16-bit field, and an appropriate 
shift is performed to comply with the standard output format 
of the HP 2644. Reference 72 contains additional details 
with regard to the software of the SPIFR onboard data acqui- 
sition system, plus the complete listing of the microproces- 
sor Assembly progreim. 
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Appendix B 

DERIVATION OF SPIFR CANDIDATE CRITERIA 


Following the definition of the SPIFR configurations 
(eq. (2“81) to (2-87)), the analytical frequency- and time- 
domain methods have to be applied to derive the candidate 
flying qualities criteria. Starting with the frequency do- 
main, the phugoid natural frequency damping and to- 
tal damping ( f w ) parameters were computed for each config- 

XI ^ 

uration (Table B.l; the configuration codes are defined in 
Table 2.1). The values for configurations 2 to 7 are iden- 
tical to the nominal values as they represent G matrix vari- 
ations, which do not affect the system's eigenvalues. 

As may be observed from Table B.l, the total damping pa- 
rameter provides the best differentiation between the con- 
figurations. Figure B.l shows the results for (fw ) in a 

n p 

histogram format. 


Even for total damping the numerical values for thirteen out 
of fifteen configurations are in the narrow range of 0.04 to 
0.07. Such clustering constitutes a disadvantage when ap- 
plying the multiple regression algorithm. 
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TABLE B.l 

Natural Response Characteristics of the SPIER Configurations 


CONFIG- 

URATION 


np SEC 


n'P SEC 


' 1 to 7 

1 

9 

10 

11 

12 

13 

0.34 

0.38 

0.28 

0.29 

0.38 

0.34 

O'. 16 

0.18 

0.14 

0.16 

0.16 

0.034 

0.054 

1 

j 

0.067 

0.040 



0.047 

0.060 

0.011 


NUMBER OF 
CONFIGURATIONS 


[♦I»| 







Next, results of the output conunand algorithm application 
to the SPIFR configurations are summarized in Table B.2. 
They are given in terms of pitch attitude and control sensi- 
tivities to flight path angle and airspeed retrimming chang- 
es . The numerical values correspond to 4-deg flight path 
angle retrimming (occurs, e.g., while leveling off from a 
500-fpm rate-of-climb) , and to a 10-kt airspeed retrimming, 
respectively. The pitch attitude sensitivity to airspeed 
retrimming was put in a histogram format in Fig. B.2. With 
regard to pitch attitude sensitivity to flight path angle 
changes, it is obvious directly from Table B.2 that it may 
not be a satsfactory configuration differentiator. One may 
observe from this table that the elevator sensitivities to 
airspeed and flight path angle changes have quite spread nu- 
merical values, as obvious from Fig. B.3 and B.4. To be 
used as general candidate criteria, they were multiplied by 
the gearing ratio, 

1.38 lb stick force/deg of elevator deflection, to become 

* * 

Af and Af^/A7„^„„, respectively. 

s' comm s' comm ^ 

Finally, the transient component of the time-domain re- 
sponse was employed for the identification of the candidate 
criteria. First, the system was excited by steps of 1-deg 
elevator deflection or 10% throttle travel, and the conse- 
quent steady-state variations in the state variables were 
computed, using eq. (2-74). Then, running the simulation 
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TABLE B.2 


Output Command Algorithm Application to SPIFR Configurations 




AV 

comm 

10 KT 



Ay = 

'comm 

4 DEG 




A0* 

DEG 


DEG 

CONFIG- 

URATION 

A6T* 

% 

CONFIG- 

URATION 

n 

CONFIG- 

URATION 

wmM 

CONFIG- 

URATION 

la 

1,2, 3, 9 
13,14 

-4.7 

10,16 

2.3 

13 

-11.0 


3.8 

3 

-1.0 

5 

11.7 

4 

-4.9 

11 

2.5 

15 

-9.9 

7,10,11 

3.9 

4 

m 

15 

12.5 

5,10 

-4.6 

7 

2.8 

12 

-4.1 

15 

3.7 

16 

0.08 

2 

12.6 

6 

-5.1 

2 

3.2 

6 

-2.5 

16 

3.9 

7 


1,6,7 
9 to 14 

12.8 

7 

-4.1 

5 

3.3 

4,9 

-2.2 

4 

4.6 

1,9 to 14 

0.12 

3,16 

12.9 

11 

-3.7 

1,13,14 

3.4 

1,2,3 


5 

3.3 

6 

0.13 

4 

14.1 

12 

-5.7 

4 

3.5 

5,10 

-1.8 

3 

4.0 

15 

0.26 



15 

-9.1 

3,6 

3.6 

7 

-0.8 



5 

0.6 



16 

-3.4 

12 

4.3 

11 




2 

1.2 





9 

4.5 

16 










15 

7.1 

14 

6.9 








from t=0 to t=20 sec, for each case the rise time t and ab - 
solute overshoot values A for the V and y output variables 
were computed. The convention here uses the flight path 
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NUMBER OF 
CONFIGURATIONS 





Figure B.2: Change in Pitch attitude for 10-kt Airspeed 
Retrimming 

variable, for which r or A are specified, as subscript; the 
control variable that initiated the transient is given in 
parentheses. The results are summarized in Tables B.3 and 
B.4. Pitch rate overshoots also were computed but, as may 
have been expected, they may not provide distinct differen- 
tiation for phugoid-response-oriented configuration changes . 
The data of Tables B.3 and B.4 are given in a histogram for- 
mat in Fig. B.5 to B.12. 
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Figure B.3; Elevator Adjustment for 10-kt Airspeed 
Re trimming 

The histograms in Figures B.l to B.12 provide a conven- 
ient indication of which of the candidate criteria are more 
likely to materialize as actual SPIFR flying qualities cri- 
teria, following the statistical analysis. For example, the 
values of the flight path angle overshoot for throttle input 
in Fig. B.12 are clustered for most of the configurations 
about the nominal and their overall variation range is only 
1.5 deg. On the other hand, the values of the flight path 
angle rise time for throttle input in Fig. B.8, are 
more evenly spread over a significantly wide range of varia- 
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Figure B.4: Elevator Adjustment for 4-deg Flight Path Angle 

Re trimming 

tion. As a result of these observations, the following dy- 
namic response characteristics were used in the SPIFR sta- 

tisical analysis; (^«*> ) , A0*/AV , Af*/AV 

n'p' ' comm' s' comm' 

^^s/'^'^comm' A^(5E), A^(5E), and 


B-7 



B-8 


TABLE B.3 


■ 



comm 

1 [DEG] 


CONFIGUR- 

ATION 

''•V 

[SEC] 

CONFIGUR- 

ATION 

[SEC] 

15 

3.75 

13 

0.38 

9,12,13 

4.0 

1 to 7,9, 
12,15 

0.75 

1 to 7 

4.5 

11,16 

1.0 

14,16 

5.0 

10 

1.25 

10,11 

5.5 

14 

1.5 















TABLE B.4 


Airspeed and Flight Path Angle Overshoot Values 



A6E 

comm 

1 [DEG] 


A6T 

comm 

= 10% 


CONFIGUR- 
ATION # 

Av 

[FPS] 

CONFIGUR- 
ATION # 

[I^EG] 

CONFIGUR- 
ATION # 

[FPS] 

CONFIGUR- 
ATION # 

[D^G] 

15 


1.7 

15 

tm 

14 

2.8 

14 

1.3 

14 


2.2 

14 

■ 

9 

2.9 

9 

1.8 

9 


2.4 

9 

2.1 

5,12 

3.0 

1,4,6,7,11 

12,15,16 

1.9 

12 


2.6 

12 

2.2 

15 

3.1 

10 

2.0 

6 


3.1 

6 

2.3 

1,6,7 

3.3 

5 

2.2 

1 to 

5 

3.3 

1 to 5 

2.5 

16 

3.45 

3 

2.3 

7 


3.9 

11 

2.8 

11 

3.6 

2,13 

2.8 

11 


4.3 

7 

2.9 

2 

3.74 



16 


4.7 

10,13 

3.1 

10 

3.9 



13 


4.8 

16 

3.4 

4 

4.1 



10 
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Figure B.5: Airspeed Rise Time for 1-deg Elevati 
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Appendix C 

LINEARIZATION OF THE SPIFR MATHEMATICAL MODEL 


C,1 LINEARIZATION OF MODEL A 


Model A is given in equations (3-22) to (3-27). 
ical derivation of state matrix F^ renders. 


p 


P 

q 


q 

r 


r 

4> 

= F 

A 

4) 

• 

0 


0 

4' 





. \ 


where 


Analyt- 


(C-1) 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


tanSsf 

tonBc^ 

qtanSdli-rtanes^ 

(qs^+rc^)/c^8 

0 

0 

(C-2) 

c* 

-8* 

-qs$-rc9 

0 

0 

0 


mt/c9 

ct/c9 

qc*/c0-rs9/ce 

2 

(q8^'frct)s0/c 6 

0 

0 , 


0 

0 

0 

0 

0 

0 
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The measurement equation (3-27) is linear. 


C.2 LINEARIZATION OF MODEL B 


Model B is given by equations (3-28) and (3-29) plus the 
associated definitions. The analytical derivation of state 
matrix preserves the structure of "flat Earth" approxima- 
tion plus "correction" terms c. 
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^11 


^31 

^22 

^13 

^23 

°33 


= -e^sin2(XQ+X)c2^1l/(l-Y)‘ 


(C-5) 


= -e^sin2(X„+X)c2ii/(l-Y)^+Ci i iC-(l-Y) 


111 ' 


+0.5e2sin22(AQ+ X) ]y.^/a/[ (1-Y )cos(X^+ X)]2 (C-6) 

= e^c^j^j^[2cos2U„+X)-£^sin22( X^+X)/(1- Y)]/(1 -y)(C-7) 




= + ciii / { l - y )‘ 


- +C2ii/(l-Y)^“yc°13'^^*^^^o'*"^^/^ 


= +e2cj^2sin2 (Xq+A) 


(C-8) 

(C-9) 

(C-10) 

(C-11) 
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where, referring to Chapter 3 and defining intermediate 
variables , 


Y = 1 - (-z^ + PQ)/a 

Pq = [l-0.5e^cos2(A^+X )] I 




c 


c 


= 0.0067 
a = 2.094xl0^ft 

111 ^^Bll“ ^B12 

211 ^ ^®B2l“ ^B22 


* 


V + hJj 3W + W^)/a 

V + hJjjW + Wy)/a 


Continuing , 


^14 ^ °141^B11 

°15 ^ ^141*^B12 

‘^le “ ‘^141^B13 

*^24 ^ °241^B11 ‘^14i“b21 

^25 ^ ^ 241^812 ^ 141^822 

^26 * ^241^613 °141®B23 

^34 “ ^341^811 

^35 “ ‘^341^812 

^36 ^341^813 


(3-16) 

(3-13) 

(3-11) 

(C-12) 

(C-13) 

(C-14) 

(C-15) 

(C-16) 

(C-17) 

(C-18) 

(C-19) 

(C-20) 

(C-21) 

(C-22) 
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Ci7 = Ci4i (C-23) 

^27 ^ *=241 (C-24) 

^28 = ‘=141 

^37 *=341 (C-26) 

where 

Ci4i = [z^/a + 0.5 £2 cos2(Xq+X):/(1-y) (C-27) 

0241 = -yj,tan(XQ+X )/a/ (1-Y ) (C-28) 

C341 = e^sin2 (X^+X )/(l-Y ) (C-29) 

Continuing, 

‘=4l'^^‘=412''“‘=411^^/^"‘^4111^Ill‘*'°4112^I13‘'''-‘=°®^^o'*‘^ ^ 

('^x“ll2"Vlll ^ ^ ( '^y^I13+^z^I12 ^ ^ ^ 

‘=5l'^^‘=41l““‘=413''^/^“‘=4111*^I2l‘*'‘=4112^I23'''^‘=°®^^o'‘‘^ ^ 

(WxH?22-Vi 21 )+sin(X^+X ) (WyH523+W^HB22 ) (C-31 ) 

‘=61^^‘=413''“‘=412“^/^"‘=4111^I3l'^‘=4112^I33‘‘‘^'=°®^^o'‘'^ ^ 

^Wx«I32-V?31^-*-®i^^^o+^^^Vl33+W2H?32)]J^/a (C-32) 

where 

C4II = n [Hj32sin( X q+X) + Hj 33 COs( Xq+X) ] (C-33) 

04^2 = n [Hj2iSin(XQ+X) + H®23 COs(Xq+X)] (C-34) 
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(C-35) 


c^j^2 ~ fl CHj2]_sin( Xq+X ) + HJ23COS ( X^+X ) ] 

= J5^[ (1-y)cos2(Xq+X) + 0 . 5e^sin^2 (X^+X ) ] (C-36) 

C 4112 =J^2[(l-Y)sin2(XQ+X)- e^sin2 ( X^+X ) cos^ ( X^+X ) ] (C-37 ) 

= 0.728x10“^ rad/sec ‘ (Section 3.1) 


Continuing, 

C43 = f2c4j^3COs(X^+X ) (C-38) 
C53 = ) (C-39) 
Cg3 = fiC42iCOs(X^+X ) (C-40) 
Cgg = Q[H®3^3 ^cos(Xq+X) - H® 3^3sin(XQ+X)] (C-41) 
C65 = -C56 (C-42) 
Cg4 = J^[Hj 2 iCOs(Xq+X) - Hj23sin(XQ+X)] (C-43) 
^=46 = -=64 

C45 = fi[H®3j^cos(XQ+X) - H®33sin(XQ+X)D (C-45) 
C54 = -C45 (C-46) 
C47 = 2(rH®2i - qH?3i) + (C-47) 
^^48 “ 2 ^^^122 “ '5^132^ “ ^413 (C-48) 
c^g = 2(rHj23 “ qH®33) - X^+X) (C-49) 
C57 = 2(-rHj^j^ + qHj3jL) + QHj22si*^( (C-50) 
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(C-51) 


^58 “ ^®I12 “ °412 

C 59 = 2(-rH®i3 + pH® 33 ) + ^ H® 22 COS (A X) (C-52) 

Cg? = 2(+qH®^j^ - pHj 2 x) + Hj32sin(A A) (C-53) 

*^68 “ 2(+qHjj^2 “ P^i22^ “ *^411 (C-54) 

Cgg = 2(+qHj3^3 - PH 523 ) + HJ 32 COS ( A^+ A) (C-55) 

The linearized measurement equation is. 


The linearized measurement equation is. 
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H 
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0 


dr 


si 




s2 


/3x„ 

/3x= 
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0 

0 

^■^Si/syc 


0 

0 

-1 


u/V v/V w/V 

-w/(V^-v^) 0 u/(V^-v^) 

-v/(V^-w^) u/(V^-w^) 0 
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0 0 0 0 0 0 
0 0 0 0 0 0 
0 0 0 0 1 0 

0 0 0 0 0 1 


(C-57) 


with 


= (■'='1*31 ■■■ ■'■‘^ysi + (C-58) 

3rsi/3yc = (1-Y )[-sin(UQ+y )Xgj^ + cos ( P^+y )yg^]/rg^ (C-59) 

3rg^/3Zc = C-cos(XQ+X)cos(y^+y)Xgj^ - cos(X^+X) 

sin(u^+y)yg. - sin(X^+X )Zg . D/r^ . (C-60) 

*si' ^si ^si given in eq. (3-18). rxl, rx2 and rx3 

are defined as follows, 

rxl = e^sin2(X^+X)cos(X^+X)cos(yQ+y)-(l-Y) 

[sin( X^+X )cos ( y^+y ) + tan(X^+X)sin(yQ+y)yj^/a] (C-61) 

rx2 = e^sin2 ( X^+X)cos( ^Q+^)sin( y^+y ) - (1-Y) 

[sin(X +X)sin(y +y) - tan(X +X)cos(y +y)y /a] (C-62) 

rx3 = e^sin2 ( X^+X)sin( X^+X) +(l_y) 


cos( Xq+X) 


(C-63) 
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C.3 IMPROVEMENT OF THE ACCURACY OF DME/DME-BASED POSITION 
ESTIMATION VIA A DME/DME/DME SCHEME 

The accuracy of the DME/DME navigational mode was 
discussed in Chapter 2. From equations (2-95) and (2-97), 

= iol + ol)/s^Q = 2a|/a^0 (C-64) 

As shown in Chapter 3, assuming simultaneous engagement 
of three DME ground stations and zero biases and wind condi- 
tions, the position determination becomes a static estima- 
tion process . Under these circumstances the covariance for- 
mula, for comparison with eq. (C-64), is derived for the 
geometrical situation of Fig. C.l. 

The aircraft is assumed to be at the coordinate origin in 
Fig. C.l (x^ = 0, Yq = 0), navigational stations A and B 
will be used for reference ( nonredundant ) position estima- 
tion, and ground station C - for creation of the DME/DME/DME 
capability. Distance measurements to stations A and B are, 

A 

^lo = ^^o-^'loJ^ + ^^o-^lo)^ 

A A 

4o = <=‘o-=‘2o>^ + <yo-y2o>^ 

Linearizing equations (.C-65) and 
trajectory and expressing the 


(C-65) 

(C-66) 

(C-66) about the nominal 
state estimation error 


C-9 



Figure C.l; Case Study of DME/DME/DME Position Estimation 
Accuracy 


Ax = [Ax Ay as a function of the measurement errors 
— o o ■'o 

Ario and Ar2Q, 


[Ax 1 
o 


■-y y" 




= (r/2xy) 




A 

_Ayo 


-X -X 




(C-67) 


The covariance matrix for the nonredundant position estima- 

A 

tion error vector Ax^^ is. 


Pq = E [Ax ^ Ax ^ ] 


(.25rVxVy^) 


-y y 


-X -X 




'^Rlo‘^R20 


^p 

^lo ^20 


R2o 


-y y 


-X -X 


(C-68) 
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and assuming that the measurement errors to stations A and B 
are uncorrelated and possess equal statistics, 

y2/x^ 0 

0 1 .. 

With some trigonometry based on Fig. C.l, 

^ o ^oll ^o22 ^ 2a|/s^e 

So far this is another way of deriving the result of eg. 
(C-64). The advantage of this approach is that interpreting 
the nonredundant measurement case as the "system" (with no 
dynamics, i.e. F = 0 and *I>= I), the additional measurement 
may be accounted for in an optimal way. The distance meas- 
urement to station C provides the measurement equation, 

Az = Arj^ = r“^[-Xj^ -yj^JAx^ + v^ = Hj^ Ax^ + (C-71) 

The Kalman filter algorithm (discussed in Chapter 3) ren- 
ders the state covariance matrix for this case, 

?! = [I - (C-72) 

where 


(C-69) 


(C-70) 


p = (0.5r^<r^/y^) 
o 
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(C-73) 


Ki = PoHICHiP^hJ + Rj] 1 
2 

with of the third DME measurement. After completion 

of the algebraic substitutions, 

2/2 . 

y /x 0 

0 l-(2+c6) 

and 

af = aj - 0.5 |cos“^(0.5e)/[l + cos2(o.50)] (C-75) 

From equations (C-70) arid (C-75), 

(ai/a^)2 = 1 - sin2(0.59)/Cl + 2cos2(O.50)] (C-76) 

For d = 90 deg, the improvement in position accuracy is 
13.5%, and for the ideal-GDOP-angle ( 0= 120 deg for this 
case) it is 29.3%, with respect to the nonredundant case. 
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Appendix D 

POST-FLIGHT PROCESSING - DETAILS 


D.l PREPROCESSING 


Post-flight data handling began using the HP-1000 digital 
computer located at Princeton University's Gas Dynamics Lab- 
oratory. The raw data was transferred to a 9-track, 1600 
BPI magnetic tape that can be processed on either the IBM 
4341 or the IBM 3081 computer. The block-diagram in Fig. 
D.l summarizes the described procedure. 

The FORTRAN program CAT9 controled the transfer from the 
DCIOOA cartridges to the 9-track magnetic tape . The FORTRAN 
program RAWYl converted 16-bit binary- formatted data into 
IBM-compatible decimal integer format and arranged the data 
in physical time vectors. The FORTRAN program SPIFYl com- 
pleted the preprocessing by converting the decimal integer 
time vectors into voltage and then - into engineering units, 
also converting Indicated AirSpeed (IAS) to True AirSpeed 
(TAS). The listings of these software programs may be found 
in Ref. 17. 
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Figure D.l: Data Reduction Procedure 

The SPIFR data storage policy was to preserve both the 
raw flight-test data and the preprocessed data on magnetic 
tapes (9-track, 1600 BPI ) , which made it compatible for fur- 
ther analysis on both the IBM 4341 and the IBM 3081 ma- 
chines. Thus, two copies of the raw integer data (RAWYl 
output file) and one copy with engineering-unit-time-vectors 
(SPIFYl output) - for further processing (analysis, tabular 
printouts or plotting) were preserved. 
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OPTIMAL FLIGHT PATH RECONSTRUCTION INPUTS 
The optimal flight path reconstruction program package 
required several input parameters, which are specific to a 
given SPIFR test-flight: 

* Record length of the data file to be processed . 

* Time vectors of codes identifying the ground stations, 
the distances to which were recorded on the two DME 
channels. This information was extracted from print- 
outs of the preprocessed data and in particular, was 
based on a channel dedicated to station switching tim- 
ings. The code convention is given in Table D.l. 


TABLE D.l 

Hexidecimal Code Recorded on the Channel that Provides 
Stations Switching Timings 


NAVl 

nAy2<^ 

- RBV 

1 

m 


SBJ . 

RBV 

EE 

ED 

! 

EB ■ 

e7 

COL 

DE 

■a 

. DB 

d7 

GXU 

BE 

. BD 

BB 

b7 

SBJ 

7e 

7d 

. 7b 

77 


D 


1-3 












The stations are: RBV - Robbinsville, COL - Colts Neck, 
GXU - McGuire and SBJ - Solberg. The stations' coordi- 
nates ( ) were obtained from Ref. 73 (Ta- 
ble D.2). The information of Table D.2 is part of the 
flight path reconstruction program package, and for 
each test-flight two timing vectors were supplied as 
input, following the code convention: 1 - RBV, 2 - COL, 
3 - GXU and 4 - SBJ. 

* Approximate values for initial conditions of the state 

variables XqA — oB based on printouts of prepro- 

cessed data. 

* ^Wx S^y' based on averaged before- and after-flight 

meteorological wind data and on Fig. 3.4. 

The program package used the JCL EXEC Language to construct 
its input data files from the preprocessed data tape li- 
brary. 
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TABLE D.2 


Navigational Stations and Forrestal Airport Reference Point 

Coordinates 


STATION 

CODE 

STATION 

H Wx' 

■B3MI 


1 

RBV 

12 a 

29.7 • 

-250 

2 

COL 

18.7 

09.6 

-120 

3 

GXU 

00.6 

35.8 

-120 


SBJ 

35 .0 ■ 

^^1.5 

-190 

0 

. FORR.’ 

.20,8. 

36.6. 

-109 




D.3 OPTIMAL FLIGHT PATH RECONSTRUCTION - PROGRAM FLOW 
CHARTS 


The program package flow charts are given in Figures D.2 
and D.3. To avoid burdening this report, all computer 
codes, which were developed in the course of this research, 
were collected in a separate supplement. Ref. 17. This doc- 
ument is available upon request. 
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Figure D.2: Forward Filtering Program 
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Figure D.3: Backward Smoothing Program 
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Appendix E 

PILOT COMMENTS AND DATA SUMMARY 


Summaries of all the pilot comments and ratings are pre- 
sented in this appendix for each configuration. All experi- 
mental results that are reported were obtained under 
zero-to-light turbulence conditions. As pointed out in Sec- 
tion 2.5, higher turbulence could have obscured the long- 
period configuration trends. The wind data at 3000 ft (deg 
of azimuth/kt) was given by the regional flight weather ser- 
vice center. The numerical values are results of averaging 
before- and after-flight weather sequence data. For a bet- 
ter estimate of surface wind, information from Forrestal, 
Newark, and Trenton airfields, and from the McGuire Air 
Force Base was averaged for mid-takeoff missions (normally 
there were 3 missions per takeoff) . The altimeter setting 
data corresponds to Forrestal airfield. As explained in 
Section 2.5, the navigational tracks, which were actually 
flown in the flight-test series, were No. 2, 3, and 4 (Fig. 
2.5 to 2.7). Following the randomization principle (Chapter 
2), the tracks were alternated, and were not repeated suc- 
cessively, unless flown on a different takeoff. The same 
principle was applied to the in-flight simulated aerodynamic 
configurations . Most of the configurations were flown 
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twice. In some cases, when objective data recording prob- 
lems occured due to checklist errors, a configuration was 
flown a third time. As detailed in Chapter 4, CHR is the 
Cooper-Harper Rating scale, and SSR is the Simpson-Sheridan 
workload scale. The experimental results reported here, 
were produced by the Princeton University Chief Test Pilot, 
whose flight experience amounts to over 600 logged IFR hours 
out of about 5000 total hours) . His reference point, when 
referring to a configuration response as "Nominal", is the 
basic Navion configuration, which is characterized by eq. 
(2-50) to (2-67).^ 


This basic configuration requires substantial (but essen- 
tially normal) power readjustment for airspeed retrimming 
to 105 kt. This biased upwards some speed retrimming 
PORS, and shows in the pilot's comments. 
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OVERALL TASK MLS DESCENT HOLDING PATTERN 


CONFIGURATION No. 1 ; NOMINAL 


Flight Test 
No. 

■ 1 

2 

Navigational 

Track 

3 

2 

Wind at 3000' 
[deg/kt] 

340/14 

250/13 

Surface Wind 
[deg/ktl 

330/5 

260/5 

Altimeter 
Setting [in Hg] 

^ 30.16 

30.00 

'Z. 

u 

CHR 

4 

3 

SSR 

4 

3 

a 

w 

lU 

cu 

Comments 

A bit "sloppy" in getting 
trimmed on new airspeed. 

Some pitch trim change 
with speed change, but in 
usual direction, OK. 

HOLDING PATTERN 

CHR 

3 

3. 

SSR 

3 

■ si 
2 

Comments 

Nominal . 

Some adjustment for wind. 

MLS DESCENT 

CHR 

3 

3 

SSR 

3— 

2 

3 

Comments 

Some trouble with holding 
glide slope needle at 
zero . 

No problem. 

TASK 

CHR 

3 

3 

SSR 

4 

3 

Comments 

Nominal task. 

Nominal with slight trim 


workload. 
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CONFIGURATION No. 2 


AM ^^>0 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 


340/14 


250/13 


Surface Wind 
Tdeg/ktl 


150/4 


260/4 


Altimeter 
Setting [in Hg] 


30.15 


30.00 




CHR 


2 — 

2 


4 


c: 

H 

cu 


SSR 


Q 

CU 

cu 

o. 


Comments 


No problem. 




Some pitch trim changes 
with power, but not of 
great concern. 


CHR 


m 


SSR 


< 

a. 


u 

z 


a 

.j 

o 


Comments 


Some crosswind causing 
poor course control. 


Nominal with distortion 
due to wind component. 


z 


i 

2 

CHR 

3 

3 

SSR 

3 

3— 

U 

tn 

UJ 

Q 

CO 

Comments 

Nominal . 

OK. 

OVERALL TASK 

CHR 

3 

3 

SSR 

3 

3i 

■^2 

Comments 

Nominal 

A bit sloppy with velocity. 
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CONFIGURATION No. 3 


5T 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 


340/14 


250/13 


Surface Wind 

rdeg/kt1 


330/5 


270/3 


Altimeter 
Setting fin Hg] 


30.17 


30.00 


o 
2 
I— t 

oC 

H 

UJ 

CHR 

3 

5 

SSR 

3 

5 

cC ^ 

o 

m 

UJ 

cu 

Comments 

Minor effor to stay 
within ± 3 kt. 

Problem trimming airspeed. 
Large trim changes in pitch 
with throttle change. 

HOLDING PATTERN 

CHR 

3 

4 

SSR 

3 

4 

Comments 

No problem. 

Problem maintaining speed; 
also large wind component 
from West distorted pattern. 

MLS DESCENT 

CHR 

3 

4 

SSR 


4 

Comments 

Some extra effort to hold 
a "nervous" glide slope. 

Problem with speed trim 
and wind component. 

OVERALL TASK 

CHR 

3 

4 

SSR 

3 

4 

Comments 

Nominal task. 

Required attention to 
speed, which hurt other 
tracking . 
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CONFIGURATION No . 4 ; 


Flight Test 
No. 

1 

2 

Navigational 

Track 

2 

4 

Wind at 3000’ 
[deg/kt] 

340/14 

250/13 

Surface Wind 
Fdeg/ktl 

330/6 

260/6 

Altimeter 
Setting [in Hg] 

30.17 

30.00 

2 : 

»— 1 

CHR 

3 

4 

q: 

E- 

UJ 

SSR 

3 


CC 




Q 

U 

UJ 

Ou 

Comments 

No problem. 

Minor problem with 
power/speed change. 

c 





CHR 

3 

3 

u 

t: 

< 

SSR 

3 

3 





u 

2 

1—* 

Q 

Comments 

No problem. 

Nominal, some wind. 

0 

=C 





CHR 

3 


f- 

2 

EU 

SSR 

3 

4 

u 

t/3 

m 

Q 

CO 

Comments 

No problem. 

Sloppy speed control and 
MLS tracking, but within 
desired limits. 


CHR 

3 



SSR 

3 

4 

u: 

to 

< 

H 

Comments 

Nominal . 

Nominal. 









0 
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CONFIGURATION No. 5 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 



Altimeter 
Setting [in Hg] 


340/14 


330/5 


30.17 



Comments I No problem. 


g Comments Fairly easy, 
o 


6T 



250/13 


260/4 


30.00 


300/7 



29.97 



Pitch trimming took Required a bit 
a bit of attention, more power than 
but not hard, to normal, but minor 

stay on speed. problem. 



No problem, except 

for strong West Nominal ; some wind 
wind component. 


E-: 





































































CONFIGURATION No. 6 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 



Altimeter 
Setting fin Hg] 


4 


340/14 


330/8 


30.17 


2N 


2 


3 


350/27 


350/9 


29.97 


3 


6 


250/13 


260/4 




Minor problem with Stable in speed 
Comments holding airspeed. trim. 


No particular 
problem. 


CHR 

3 

SSR 

3 

Comments 

No problem. 

1 

CHR 

3 

SSR 

3 

Comments 

No particular 


problem. 

CHR 

3 

SSR 

3 

Comments 

Nominal . 



due to large cross-1 No real problem, 



Nominal approach; 
slight compensa- 
tion for headwind. 


Nominal . 



Large wind com- 
ponent from North. Nominal. 
Nothing signifi- 
cant noticed about 
the configuration. 
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CONFIGURATION No. 7 


'6E 


= -2N 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000* 
[deg/kt] 


350/11 


L/V (light and variable) 


Surface Wind 
fdeg/ktl 


020/4 


90/9 


Altimeter 
Setting [in Hg] 


30.23 


30.01 




a: 

t- 

lU 

o: 

o 

(U 

UJ 

o. 


CHR 


4 


SSR 


4 


'Comments 


No problem. 


A little "loose" in air- 
speed holding. Requires 
small corrections in 
attitude . 


CHR 


m 

[: 

< 

a. 

o 

z 

a 


SSR 


Comments 


Fairly easy. 


No particular problem. 


o 

z 



CHR 

1 

3 

3 

z 

UJ 

SSR 

3 

4 

u 

CO 

UJ 

a 

CO 

Comments 

Nominal 

Tracking OK; just required 
power adjustments for 
airspeed re trimming. 


CHR 

3 

3 


SSR 

3 

3 

OVT-RALL TASK 

Comments 

Nominal 

task. 

Nominal; just a little 
airspeed concern. 

i 
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CONFIGURATION No . 9 ; AM^>0 


Flight Test 
No. 

1 

2 

3 

Navigational 

Track 

3 

2 

4 

Wind at 3000' 
[deg/kt] 

350/11 

L/V (light and 
variable) 

300/7 

1 

1 

030/5 

110/4 

0/7 

Altimeter 

Setting fin Hg] 

30.26 

30.00 

29.97 

CD 
2: 
»— < 

1 

CHR 

4 

3 

3 

a 

H 

(U 

SSR 

4 

4 

4 

cc 

o 

m 

m 

a. 

h-4 

Comments 

Large trim change 
rfith speed change. 

Takes a lot of trim 
wheel, but holds 
good once trimmed. 

More attention than 
normal to pitch 
trim, but no 
problem. 


CHR 

3 

3 

3 

m 

t: 

< 

SSR 

3 

3 

3 

o 
2 
1— 1 
O 
.J 

o 

2 

Comments 

No problem. 

No problem. 

Some wind distor- 
tion, but OK. 


CHR 

3 

3 

4 

H 

2 

tu 

SSR 

3 

3 

4 

u 

C/D 

03 

Q 

C/D 

Comments 

No problem. 

Nominal . 

No problem. 


CHR 

3— 

2 

3 

3 


SSR 

3— 

3 

3 

OVERALL TASK 

Comments 

Nominal except 
for speed re- 
trimming . 

Large trim wheel 
movement , but 
otherwise fine. 

Nominal . 
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CONFIGURATION No. 10 


Flight Test 
No. 


AM <0 
u 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 




Altimeter 
Setting [in Hg] 


350/11 


45/6 


30.29 


L/V Qight and variable) 


100/7 


30.01 




Very "loose" in speed 
control. No large forces, 

C0jniU6TltS ^111 .A. • . 

actually low trim amounts 
but constantly re trimming 


Very unstable in speed trim; 
constant attention and power 
adjustments for attitude 
trim. 



Q jComments I No particular problem. 


Nominal . Some loss of 
tracking accuracy, while 
copying clearances. 



Additional effort of air- 
Comments speed holding while MLS 
tracking. 


Able to track MLS quite 
well, but constantly 
chasing airspeed. 



H IComments holding. 


Moderate effort in speed 


Airspeed variations up to 
±8 kt are annoying, but do 
not degrade the task 
appreciably. 
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CONFIGURATION No. 11 


AZ = -0.3N 
u 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 


L/V (light and variable) 


300/7 


Surface Wind 
fdeg/ktl 


110/4 


290/5 


Altimeter 
[Setting [in Hg] 


30.00 


29.95 


u 


cc. 

H 

UJ 

b; 

a 

tu 

(U 

a. 


CHR 


4 


SSR 


'Comments 


CHR 


Can change airspeed fairly 
rapidly, but seems a bit 
hard to hold; takes 
constant attention. 


No particular problem. 


w 

< 

a. 


SSR 


ID 

Z 


No particular problem. 

Some North wind component 

O 

Comments 

just monitoring speed and 

detected. 

o 


taking clearances. 


X 





CHR 

3 

3 

H 

SSR 

4 

3 

Z 








u 

CO 

UJ 


Tracking OK, just busy 


Q 

Comments 

with speed trimming 

Nominal . 

CO 


with power. 



CHR 

3 

3 


SSR 

4 

3 





to 

< 


Speed holding a little 


H 

Comments 

sloppy. 

No problem. 













o 
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CONFIGURATION No. 12 ; AZ = +0.3N 

_ _ _ _ u 


Flight Test 
No. 

1 

2 

3 

Navigational 

Track 

4 

2 

3 

Wind at 3000' 
[deg/kt] 

350/11 

L/V Clight and 
variable") 

280/5 

IcSSSiHli 

45/6 

110/4 

230/3 

Altimeter 
Setting fin Hg] 

30.29 

30.00 

30.17 

0 
2 
►— 1 

1 

CHR 

4 

4 

4 

l-H 

a 

H 

UJ 

SSR 

5 

4 

4 

CC 

O 

tu 

tu 

a. 

Comments 

Large pitch atti- 
tude change while 
retrimming. Actual 
speed holds OK 

nnop rm 

Fairly large atti- 
tude change with 
speed but no great 
problem. More power 

ad jimt.mRTit. than'Misu 

More than "usual" 
power adjustments. 

i1". 


CHR 

3 

3 

4 

lU 

H 

H 

< 

SSR 

3 

3 

3 

u 
2 
(— < 
a 

.j 

o 

X 

Comments 

No problem. 

Nominal, but copy- 
ing clearances 
distorted the 
pattern. 

Nominal. Sloppy 
pattern due to 
clearances dis- 
traction. 


CHR 

3 

3 

3 

H 

2 

UJ 

SSR 

3 

3— 

2 

3 

u 

t/D 

LU 

Q 

to 

Z 

Comments 

No problem. 

No particular 
problem. 

Nominal . 


CHR 

4 

3 

3— 

2 


SSR 

4 

4 

3— 

■^2 

to 

< 

t— 

cn 

O 

Comments 

No significant 
problems. 

Slight increase in 
workload due to 
power adjustments 
while re trimming 
to new airspeed. 

Some extra drag 
at 105 kt, but 
OK. 
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CONFIGURATION No. 13 


Flight Test 
No. 


Navigational 

Track 


Wind at 3000' 
[deg/kt] 


= 0 




Altimeter 
Setting [in Hg] 


L/V (light and variable) 


110/4 


30.00 


300/7 


010/6 


29.97 



a Airspeed wanders and Noted rapid deceleration 

S Comments requires constant attention in speed reduction. 

^ to power setting. 



_ Slight concern with small 

Comments . j 

wind component. 


Adjustments for wind. 



A bit of a bother 
Comments holding airspeed. 



^ ^ "Sloppy" airspeed control. 

H Comments ^ 


Some monitoring of power 
required. 
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CONFIGURATION No. 14 ; X = 2N 

u 


Flight Test 
No. 

1 

2 

Navigational 

Track 

3 

3 

Wind at 3000* 
[deg/kt] 

300/7 

300/7 

Surface Wind 
Fdeg/ktl 

230/5 

010/6 

Altimeter 
Setting fin Hg] 

30.22 

29.97 

o 

z 

HH 

CC 

H 

CHR 

4 

3 

SSR 

4 

4 

Q 

ua 

tu 

Q- 

Comments 

Needed several readjust- 
ments of power to trim 
to new airspeed. 

Noted slow airspeed change, 
took longer to trim and 
adjust throttle but minor 
problem. 

UJ 

< 

CHR 

3 

3 

SSR 

■ 3— 
2 

3 

o 

z 

►—1 

a 

o 

n: 

Comments 

Strong wind component re- 
quires some planning to 
keep pattern at proper size 

Some distortion due to wind. 

MLS DESCENT 

CHR 

3 

3 

SSR 

3 

3 

H 

Nominal . 

OK. 


CHR 

3 

3 

SSR 

4 

3 

CO 

< 

t- 

Comments 

Nominal . 

Nominal, with some work 
with throttle adjustments. 


o 
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CONFIGURATION No. 15 ; AZ., = -0.5N 

w 


.Flight Test 
No. 

1 

2 

Navigational 

Track 

2 

3 

Wind at 3000' 
[deg/kt] 

300/7 

300/7 

Surface Wind 
[deg/ktl 

250/6 

250/6 

Altimeter 
Setting fin Hg] 

30.20 

30.20 

o 
z 
1— 1 

CHR 

4 

5 

a: 

H 

m 

SSR 

4 

5 

OC 

Q 

lU 

m 
»— ( 

Comments 

Large pitch attitude 
change with speed change. 

Large attitude excursions 
and trim wheel motions. 


CHR 

3 

4 

tv 

< 

SSR 


4 

Cm 

C3 

Z 

t— 1 

a 

.j 

o 

z 

Comments 

Mild compensation for 
strong wind components . 

Distracting problems with 
attitude and speed re- 
trimming . 


CHR 


4 

H 

Z 

UJ 

SSR 

4 

• 

5 

u 

C/D 

UJ 

a 

CO 

Comments 

Requires a little extra 
effort to get trimmed on 
airspeed and at correspond- 
ing attitude. 

Distracting problem with 
attitude retrimming. 


CHR 

4 

4 


SSR 

4 

5 

VERALL TASK 

Comments 

A little extra concern due 
to "different" relation- 
ships between parameters. 

Large attitude and trim 
changes . 


I 
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CONFIGURATION No. 16 


Flight Test 
No. 


AZ = +0.5N 
w 


Navigational 

Track 


Wind at 3000’ 
[deg/kt] 




Altimeter 
Setting [in Hg] 


300/7 


240/5 


30.21 


300/7 


330/5 


29.97 




Comments I No problem. 


No significant problem. 



Strong wind required a Somewhat distorted pattern 

Comments little compensation to due to NE wind of 

minimize pattern distortion, significance. 
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